-- Logs begin at Wed 2022-09-14 14:42:48 UTC, end at Wed 2022-09-14 15:38:02 UTC. -- Sep 14 15:10:21.344013 dv-osbrick-853789-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 15:10:21.351307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 15:10:21 2022] *** Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: nodename: dv-osbrick-853789-4-iscsi Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: machine: x86_64 Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: clock source: unix Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: pcre jit disabled Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: detected number of CPU cores: 4 Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: current working directory: / Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: detected binary path: /usr/bin/uwsgi-core Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: your processes number limit is 47680 Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: your memory page size is 4096 bytes Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: detected max file descriptor number: 2048 Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: lock engine: pthread robust mutexes Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: thunder lock: enabled Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 15:10:21.357560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 15:10:21.395856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: Python main interpreter initialized at 0x55c5c20069c0 Sep 14 15:10:21.395856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: python threads support enabled Sep 14 15:10:21.395856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: your server socket listen backlog is limited to 100 connections Sep 14 15:10:21.395856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: your mercy for graceful operations on workers is 90 seconds Sep 14 15:10:21.396268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 15:10:21.396268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: *** Operational MODE: preforking *** Sep 14 15:10:21.396556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: *** uWSGI is running in multiple interpreter mode *** Sep 14 15:10:21.396556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: spawned uWSGI master process (pid: 81413) Sep 14 15:10:21.396765 dv-osbrick-853789-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 14 15:10:21.397905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: spawned uWSGI worker 1 (pid: 81427, cores: 1) Sep 14 15:10:21.397905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: spawned uWSGI worker 2 (pid: 81428, cores: 1) Sep 14 15:10:21.397905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81413]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 15:10:25.683072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:10:25.683072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: from cryptography.utils import int_from_bytes Sep 14 15:10:25.684010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:10:25.684010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: from cryptography.utils import int_from_bytes Sep 14 15:10:25.684598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:10:25.684598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: from cryptography.utils import int_from_bytes Sep 14 15:10:25.684723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:10:25.684723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: from cryptography.utils import int_from_bytes Sep 14 15:10:25.734425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 15:10:25.734636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 15:10:25.734797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] command line args: [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 15:10:25.734935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 15:10:25.735071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 15:10:25.735197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 15:10:25.735335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] command line args: [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 15:10:25.735467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ================================================================================ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 15:10:25.735467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] admin_token = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.735710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 15:10:25.735710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ================================================================================ {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 15:10:25.735948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] config_dir = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.735948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.736098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] admin_token = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.736163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] config_source = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.736274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] config_dir = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.736377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] debug = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.736467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.736588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.736953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] config_source = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] debug = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.737929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.738039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.738171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.738340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] log_config_append = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.738340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.738610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.738742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] log_dir = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.738742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] log_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.739068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] list_limit = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.739255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.739432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] log_config_append = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.739432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.739777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.740006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] log_dir = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.740151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.740280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] log_file = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.740415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.740548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.740749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.740886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.741022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.741152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.741337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.741480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.741676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.741813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.741948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.742163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.742318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.742467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.742599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.742599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.742836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.742919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] publish_errors = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.743943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744406 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] publish_errors = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.744812 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] standard_threads = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] use_journal = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] standard_threads = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] use_json = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.745950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] use_stderr = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] use_syslog = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] use_journal = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.746738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] use_json = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.746875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] use_stderr = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.746875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] use_syslog = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.747053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:10:25.747207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.747990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.748073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.748145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.748265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.748339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.748408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.748966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.749885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.750862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.751868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.752955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.753986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.754938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.755878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.756932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.757974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.758904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.759968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.760964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.761912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.762924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.763985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.764773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.764860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.764932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.765948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.766887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.767857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.768922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.769919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.770850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.771007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.771096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.771269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.771503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.external = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.771631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.771723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.771902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.password = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.token = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] auth.external = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.772982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] auth.password = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.773961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.774112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] auth.token = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.774190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.774348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.774434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.774585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.774928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.775945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] credential.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.776868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.777976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.778951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.779990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.780947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.781975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.782911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.783915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.784966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.785975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.786943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.787912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.788848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.789946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.790973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.791982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.792953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.793901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.794984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.795144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.795271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.795403 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.795485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.795643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.795722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.795968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796532 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.796994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.797924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.798868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.799981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.800915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.801924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.802870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.803990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.804948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] role.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] role.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.805982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] role.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] role.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.806898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.807875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.808862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809759 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.809930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.810895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.811583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.811665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.811858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.811940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.812892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.813964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.814994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.815970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.816123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.816203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.816373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.816452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.816610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.816754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.816839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.817890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.818997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.819984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.connection = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.820933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.821943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.822951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 15:10:25.823025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.823263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.823512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.823745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.824010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.824706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.824913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.825148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:10:25.825316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 15:10:25.852992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.853149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.853371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.854017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.854249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.854470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.862886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.864195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.891756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.891997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.893158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.893389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.946068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.947327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.994989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.995212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.995469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:25.995706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.152657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.152828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.153017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.153230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.153395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.153536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.153665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.153799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.153931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.154071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.154228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.154442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.176795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.177965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.178093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.178221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.178348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.178475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.178475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.189295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.189639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.202700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.202926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.203058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.203204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.203334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.203460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.203588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.203714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.203892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.204022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.204148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.204274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.204399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.204399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:10:26.221062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.221266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:10:26.221546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.221676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.221802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:10:26.221953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:10:26.222082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.222206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.222341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:10:26.222467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.222600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.222725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.222850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.222976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.223100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.223265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.232562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.232828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.232959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.233118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.233242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.233380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.233507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.233643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.240301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.240575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.243164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.243441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.243571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.243698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.243851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.244920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.245933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.246101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.268850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.269179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.270319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.270596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.270725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.270934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.275605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.275923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.276063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.276192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.276331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.276521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.283499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.283727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.283881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.284043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.289595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.289816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.289946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.290107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.290236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.290382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.290516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.290656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.290787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.290918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.291056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.291187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.291317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.291578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.291709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.306825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.306987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.307116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.307249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.311041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.311198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.314246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.314392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.314546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.314675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.318687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.318845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.321838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.322023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.325032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.325208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.325339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.325496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.325647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.325776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.325911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.326057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.326189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.326315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.326440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.327068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.343236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.343498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.343630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.343757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.343906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.344061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.344188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.344320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.350857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.350999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.352431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.352632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.353931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.354084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.354211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.354342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.356887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.357041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.357173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.357305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.357436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.357577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.357706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.357838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.358105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.358191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.369170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.369322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.369471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.369611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.369733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.369875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.370015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.370161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.370447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.370543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.370682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.370819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.370961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.371099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.386657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.386895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.390144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.390355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.393036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.393262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.394563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.394794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.396235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.396367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.396494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.396584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.396883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.396975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.403507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.403615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.405014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.405124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.407882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.407988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.408278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.408364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.408563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.408674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.408841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.408921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.416586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.416686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.416871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.416972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.417149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.417240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.424042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.424153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:10:26.424326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.424609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.424700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.424889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.424981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.425168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.425261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.425444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.425537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.425718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.425819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.425995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.426097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.426272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.426373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.426539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.426630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.426805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.426898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.427072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.427185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.427342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.427550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.427634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.427882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.428164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:10:26.462345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c5c20069c0 pid: 81427 (default app) Sep 14 15:10:26.463023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c5c20069c0 pid: 81428 (default app) Sep 14 15:10:26.465677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ddc7a-88f9-44e0-bad5-fc4af99a8f64 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:26.465963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ddc7a-88f9-44e0-bad5-fc4af99a8f64 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:26.466235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ddc7a-88f9-44e0-bad5-fc4af99a8f64 None None] PATH_INFO: `/v3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:26.470432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Wed Sep 14 15:10:26 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:33.272643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f3a8-c021-4efe-a683-1d55b0d38451 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:33.273162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f3a8-c021-4efe-a683-1d55b0d38451 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:33.273162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f3a8-c021-4efe-a683-1d55b0d38451 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:33.277692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:10:33.283609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:33.284147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:33.284241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:33.354389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: INFO dbcounter [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] Registered counter for database keystone Sep 14 15:10:33.373829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG oslo_db.sqlalchemy.engines [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 15:10:33.382302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writer thread running {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 15:10:33.563258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG passlib.handlers.bcrypt [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81427) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 15:10:33.563553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG passlib.handlers.bcrypt [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81427) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 15:10:33.622114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:33.623738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:33.752375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 15:10:34.272772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3f3a8-c021-4efe-a683-1d55b0d38451 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:34.342736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: INFO dbcounter [None req-96d3f3a8-c021-4efe-a683-1d55b0d38451 None None] Registered counter for database keystone Sep 14 15:10:34.364483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG oslo_db.sqlalchemy.engines [None req-96d3f3a8-c021-4efe-a683-1d55b0d38451 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 15:10:34.370563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writer thread running {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 15:10:34.492014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3f3a8-c021-4efe-a683-1d55b0d38451 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:34.496324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c222d38-d683-4e30-a00b-9664309aa7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:34.496949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222d38-d683-4e30-a00b-9664309aa7bd admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:34.497228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222d38-d683-4e30-a00b-9664309aa7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:34.497499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222d38-d683-4e30-a00b-9664309aa7bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:34.506744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c222d38-d683-4e30-a00b-9664309aa7bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:34.558141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5c222d38-d683-4e30-a00b-9664309aa7bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 15:10:34.558394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c222d38-d683-4e30-a00b-9664309aa7bd admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:34.569488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Sep 14 15:10:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 15:10:34.575544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:34.593517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b5b5d-946d-43c7-b59c-100703a709f3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:34.598216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802eab5-465d-4f3b-a8de-b4bb28c8eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:34.599362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802eab5-465d-4f3b-a8de-b4bb28c8eb56 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:34.599638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802eab5-465d-4f3b-a8de-b4bb28c8eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:34.599942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802eab5-465d-4f3b-a8de-b4bb28c8eb56 admin admin] PATH_INFO: `/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:34.601628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802eab5-465d-4f3b-a8de-b4bb28c8eb56 admin admin] RBAC: Authorizing `identity:get_project(project_id=52aec70ff9234a3bb3cc3d70110b0f57)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:34.654311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9802eab5-465d-4f3b-a8de-b4bb28c8eb56 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 15:10:34.655145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802eab5-465d-4f3b-a8de-b4bb28c8eb56 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:34.659876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Wed Sep 14 15:10:34 2022] GET /identity/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:36.849887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192fe0-f0cf-4e93-96a5-681118a9b6b3 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:36.850369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192fe0-f0cf-4e93-96a5-681118a9b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:36.850369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192fe0-f0cf-4e93-96a5-681118a9b6b3 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:36.854459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:10:36.860691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648c8d7-2c9a-40a3-9cd8-ddf69619f1b6 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:36.861088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648c8d7-2c9a-40a3-9cd8-ddf69619f1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:36.861248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648c8d7-2c9a-40a3-9cd8-ddf69619f1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:36.881057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c648c8d7-2c9a-40a3-9cd8-ddf69619f1b6 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:36.882579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c648c8d7-2c9a-40a3-9cd8-ddf69619f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:36.890654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 15:10:37.157090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90192fe0-f0cf-4e93-96a5-681118a9b6b3 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:37.169064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90192fe0-f0cf-4e93-96a5-681118a9b6b3 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:37.173890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3fe5a-8ed4-4cad-9c87-fc79b963f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:37.174476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3fe5a-8ed4-4cad-9c87-fc79b963f6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:37.174749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3fe5a-8ed4-4cad-9c87-fc79b963f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:37.175015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3fe5a-8ed4-4cad-9c87-fc79b963f6b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:37.182477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3fe5a-8ed4-4cad-9c87-fc79b963f6b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:37.184270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3fe5a-8ed4-4cad-9c87-fc79b963f6b0 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:37.192975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Sep 14 15:10:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 15:10:37.198484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648c8d7-2c9a-40a3-9cd8-ddf69619f1b6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:37.207629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648c8d7-2c9a-40a3-9cd8-ddf69619f1b6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:37.212051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e49253-bde0-41eb-ac19-9bd849173ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:37.212672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e49253-bde0-41eb-ac19-9bd849173ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:37.212954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e49253-bde0-41eb-ac19-9bd849173ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:37.213230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e49253-bde0-41eb-ac19-9bd849173ac1 admin admin] PATH_INFO: `/v3/users/ea41adfa24e148959dc896e18ec4fb9f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:37.214576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e49253-bde0-41eb-ac19-9bd849173ac1 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea41adfa24e148959dc896e18ec4fb9f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:37.216449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e49253-bde0-41eb-ac19-9bd849173ac1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:37.218463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Wed Sep 14 15:10:37 2022] GET /identity/v3/users/ea41adfa24e148959dc896e18ec4fb9f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:39.504757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ad57-75ca-4379-b105-2d3d7fb7d0f3 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:39.505327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ad57-75ca-4379-b105-2d3d7fb7d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:39.505327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ad57-75ca-4379-b105-2d3d7fb7d0f3 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:39.506618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:39.511990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd101d-6c58-420b-85ea-cab9f4b5793d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:39.512445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd101d-6c58-420b-85ea-cab9f4b5793d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:39.512548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd101d-6c58-420b-85ea-cab9f4b5793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:39.530085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4d7f7-4f8a-489e-b6f7-33573e89ac0c None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:39.530436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4d7f7-4f8a-489e-b6f7-33573e89ac0c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:39.530717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4d7f7-4f8a-489e-b6f7-33573e89ac0c None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:39.530954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c1bd101d-6c58-420b-85ea-cab9f4b5793d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:39.532153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:10:39.532274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c1bd101d-6c58-420b-85ea-cab9f4b5793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:39.537193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:39.537469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:39.537745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:39.580497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG passlib.handlers.bcrypt [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81428) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 15:10:39.580882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG passlib.handlers.bcrypt [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81428) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 15:10:39.624488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:39.630457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:39.632098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:39.733435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:39.986259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd101d-6c58-420b-85ea-cab9f4b5793d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:39.999626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:40.019536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:40.115926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd101d-6c58-420b-85ea-cab9f4b5793d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.121720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7b2b-aae6-4ad0-ab73-9686d9685d14 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.124103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:40.161066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.162170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.162455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.162728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.163695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.164406 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.164689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.164972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.175563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:10:40.184130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:40.185135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:10:40.186047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 8/14] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:10:40.192729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:40.251901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:40.254098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:40.282371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:40.298573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f771-12a5-4a27-89d0-852c050b223a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.337222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.337820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.338098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.338369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.339040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:40.339351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:40.340826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:40.353574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 9/15] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:10:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:40.359332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:40.369978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 7/16] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:10:40.375510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:40.386730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:40.465489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93bbd-236c-4cf2-b873-fe49ad2361fc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.481827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f477f-0e56-400c-973f-f55aa6be39f7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.502468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.503016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.503295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.503569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] PATH_INFO: `/v3/users/ea41adfa24e148959dc896e18ec4fb9f` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.505091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] RBAC: Authorizing `identity:get_user(user_id=ea41adfa24e148959dc896e18ec4fb9f)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:40.506541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:40.508361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 10/17] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:10:40 2022] GET /identity/v3/users/ea41adfa24e148959dc896e18ec4fb9f => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:40.510839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:40.514416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:40.525087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.525729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.526006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.526276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.537189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:40.538679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:10:40.556871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:40.557793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:10:40.558825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:10:40.558825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:10:40.558825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:10:40.558825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 8/18] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:10:40.563775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:40.614153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:40.621327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373a1e-5083-4790-b731-77a26b00f326 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.656846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.657485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.657764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.658034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.659161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:40.660654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:40.662230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 11/19] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:40.668189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:40.673531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fbb81-239c-4781-9d39-6ae03f341c98 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.709354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629b57f-cda0-424e-bfe8-37d0e80bc81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.709975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629b57f-cda0-424e-bfe8-37d0e80bc81e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.710253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629b57f-cda0-424e-bfe8-37d0e80bc81e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.710525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629b57f-cda0-424e-bfe8-37d0e80bc81e None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.711177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629b57f-cda0-424e-bfe8-37d0e80bc81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:40.711479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629b57f-cda0-424e-bfe8-37d0e80bc81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:40.712927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629b57f-cda0-424e-bfe8-37d0e80bc81e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:40.730641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 9/20] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:40.783585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06223c-a37e-4242-a7b5-f20cea662ab8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:40.820471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c2b20-625d-4575-b604-1f8d8cf38372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:40.821090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c2b20-625d-4575-b604-1f8d8cf38372 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:40.821363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c2b20-625d-4575-b604-1f8d8cf38372 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:40.821628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c2b20-625d-4575-b604-1f8d8cf38372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:40.822375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c2b20-625d-4575-b604-1f8d8cf38372 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.domain.id=default, user.id=ea41adfa24e148959dc896e18ec4fb9f) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:40.822675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c2b20-625d-4575-b604-1f8d8cf38372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:40.824174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c2b20-625d-4575-b604-1f8d8cf38372 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:40.834859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 12/21] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Sep 14 15:10:40 2022] GET /identity/v3/role_assignments?user.id=ea41adfa24e148959dc896e18ec4fb9f&scope.domain.id=default&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 233 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:43.263781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fe367-1d16-4931-be18-1bba24208af7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:43.264298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fe367-1d16-4931-be18-1bba24208af7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:43.264396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fe367-1d16-4931-be18-1bba24208af7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:43.265841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 10/22] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:43.271379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf588eb-8fc2-4855-8c07-288be6502e7f None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:43.272211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf588eb-8fc2-4855-8c07-288be6502e7f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:43.272699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf588eb-8fc2-4855-8c07-288be6502e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:43.300879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-5cf588eb-8fc2-4855-8c07-288be6502e7f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:43.302368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5cf588eb-8fc2-4855-8c07-288be6502e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:43.324086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcc312-9c3c-4411-937e-c2c6c5f0cec0 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:43.324362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcc312-9c3c-4411-937e-c2c6c5f0cec0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:43.324635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcc312-9c3c-4411-937e-c2c6c5f0cec0 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:43.325988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 11/23] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:10:43.328349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:43.332762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299bc4c-34e2-4911-9cfc-f4a3be2ec30e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:43.333066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299bc4c-34e2-4911-9cfc-f4a3be2ec30e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:43.333279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299bc4c-34e2-4911-9cfc-f4a3be2ec30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:43.364868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3299bc4c-34e2-4911-9cfc-f4a3be2ec30e None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:43.366089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3299bc4c-34e2-4911-9cfc-f4a3be2ec30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:43.410998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 13/24] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:43.428442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:43.498879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 12/25] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:43.779997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3288-3c20-42a1-b9d5-0a44afbdb05e None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:43.780745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3288-3c20-42a1-b9d5-0a44afbdb05e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:43.780874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3288-3c20-42a1-b9d5-0a44afbdb05e None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:43.782416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 14/26] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:43.794191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae7b6-fc10-4226-ba35-347eb9e262e9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:43.794530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae7b6-fc10-4226-ba35-347eb9e262e9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:43.795281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae7b6-fc10-4226-ba35-347eb9e262e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:43.820916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-273ae7b6-fc10-4226-ba35-347eb9e262e9 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:43.822135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-273ae7b6-fc10-4226-ba35-347eb9e262e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:43.923044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 13/27] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:43.984608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3288-3c20-42a1-b9d5-0a44afbdb05e None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:44.005097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ae7b6-fc10-4226-ba35-347eb9e262e9 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:44.174247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3288-3c20-42a1-b9d5-0a44afbdb05e None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:44.217517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:44.233808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ae7b6-fc10-4226-ba35-347eb9e262e9 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:44.291045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:44.292287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:44.292733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:44.293135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:44.307486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:44.308434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:44.308846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:44.309249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:44.335287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:44.335936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:10:44.337838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:10:44.341148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:44.342564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:44.343299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:10:44.345702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 15/28] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:10:44.346679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:10:44.367068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:44.368645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:10:44.370185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:10:44.370185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:10:44.370185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:10:44.373260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 14/29] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:10:44.374713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:44.390050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:44.535897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a1547-9341-490d-a09a-b6b0f5d75a25 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:44.591203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:44.592809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:44.593537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:44.594145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:44.595408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:44.596131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:44.598732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:44.602144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99813-c497-4ee9-8024-53e5826f890d None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:44.626101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 15/30] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:44.627464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:44.652179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:44.713547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa0ca5-9c79-4932-89dc-c8655a051b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:44.714256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa0ca5-9c79-4932-89dc-c8655a051b0c None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:44.714530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa0ca5-9c79-4932-89dc-c8655a051b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:44.714799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa0ca5-9c79-4932-89dc-c8655a051b0c None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:44.715537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa0ca5-9c79-4932-89dc-c8655a051b0c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:44.717137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa0ca5-9c79-4932-89dc-c8655a051b0c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:44.740111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adcb8b-d28f-4a46-b362-a4330d31d2d4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:44.786929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434609c-f921-41d3-a902-9072af718248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:44.788036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434609c-f921-41d3-a902-9072af718248 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:44.788508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434609c-f921-41d3-a902-9072af718248 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:44.788987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434609c-f921-41d3-a902-9072af718248 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:44.789939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434609c-f921-41d3-a902-9072af718248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:44.790480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434609c-f921-41d3-a902-9072af718248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:44.792184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434609c-f921-41d3-a902-9072af718248 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:44.806183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 16/31] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:44.812518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434609c-f921-41d3-a902-9072af718248 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:44.884726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:44.885628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 16/32] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Sep 14 15:10:44 2022] POST /identity/v3/roles => generated 219 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:10:44.888335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5355e-0e87-4635-8272-ecf6ab0ba3fb None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:44.888729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5355e-0e87-4635-8272-ecf6ab0ba3fb None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:44.888959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5355e-0e87-4635-8272-ecf6ab0ba3fb None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:44.890583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 17/33] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:44.895115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5355e-0e87-4635-8272-ecf6ab0ba3fb None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:44.973074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434609c-f921-41d3-a902-9072af718248 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:45.014736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4681-d814-4ff8-861c-a1c6cded82be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:45.015905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4681-d814-4ff8-861c-a1c6cded82be None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.016391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4681-d814-4ff8-861c-a1c6cded82be None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.016898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4681-d814-4ff8-861c-a1c6cded82be None admin] PATH_INFO: `/v3/users/ea41adfa24e148959dc896e18ec4fb9f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.018438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff4681-d814-4ff8-861c-a1c6cded82be None admin] RBAC: Authorizing `identity:get_user(user_id=ea41adfa24e148959dc896e18ec4fb9f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:45.020384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff4681-d814-4ff8-861c-a1c6cded82be None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:45.022339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 17/34] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:10:44 2022] GET /identity/v3/users/ea41adfa24e148959dc896e18ec4fb9f => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:45.023882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102c5bf-ee5a-4b69-b009-5161e37c179f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.024377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102c5bf-ee5a-4b69-b009-5161e37c179f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.025092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102c5bf-ee5a-4b69-b009-5161e37c179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.059906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a102c5bf-ee5a-4b69-b009-5161e37c179f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:45.063559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a102c5bf-ee5a-4b69-b009-5161e37c179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:45.096638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:45.142318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5355e-0e87-4635-8272-ecf6ab0ba3fb None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:45.173989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 18/35] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:45.176559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102c5bf-ee5a-4b69-b009-5161e37c179f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:45.199316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31d4d-0bba-4894-925b-8895d83bbc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:45.200072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31d4d-0bba-4894-925b-8895d83bbc1a None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.200409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31d4d-0bba-4894-925b-8895d83bbc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.200693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31d4d-0bba-4894-925b-8895d83bbc1a None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.201705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb31d4d-0bba-4894-925b-8895d83bbc1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:45.203676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb31d4d-0bba-4894-925b-8895d83bbc1a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:45.258536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 18/36] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:10:44 2022] POST /identity/v3/projects => generated 301 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:10:45.282944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:45.320197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212737ec-d089-44ca-8f02-dc0951021b42 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.320705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212737ec-d089-44ca-8f02-dc0951021b42 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.320705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212737ec-d089-44ca-8f02-dc0951021b42 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.322273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 19/37] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:45.329162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cafb2-d28a-4446-878e-8caacb5e2ce4 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.329470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cafb2-d28a-4446-878e-8caacb5e2ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.329712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cafb2-d28a-4446-878e-8caacb5e2ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.356814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102c5bf-ee5a-4b69-b009-5161e37c179f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:45.360987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-390cafb2-d28a-4446-878e-8caacb5e2ce4 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:45.362591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-390cafb2-d28a-4446-878e-8caacb5e2ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:45.421789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:45.422496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.423018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.423298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.424662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:45.426292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:45.428308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 19/38] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:45.434317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:45.486553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 20/39] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:45.495839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be729e0-f9b6-4dcb-9440-95d01dee42c6 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.495839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be729e0-f9b6-4dcb-9440-95d01dee42c6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.495839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be729e0-f9b6-4dcb-9440-95d01dee42c6 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.495839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 21/40] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:45.495839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b89c-76b9-415c-a11d-f9ad4c9873c0 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.495839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b89c-76b9-415c-a11d-f9ad4c9873c0 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.496322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b89c-76b9-415c-a11d-f9ad4c9873c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.519848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-32e7b89c-76b9-415c-a11d-f9ad4c9873c0 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:45.520905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-32e7b89c-76b9-415c-a11d-f9ad4c9873c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:45.582294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630dfa6-3dc3-4392-a53b-939967cfd58e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:45.594069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:45.627981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 22/41] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:45.629254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b89c-76b9-415c-a11d-f9ad4c9873c0 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:45.637592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:45.638698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.639172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.639647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] PATH_INFO: `/v3/domains/default/users/ea41adfa24e148959dc896e18ec4fb9f/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.642132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea41adfa24e148959dc896e18ec4fb9f, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:45.643854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:45.646983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:45.745903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b89c-76b9-415c-a11d-f9ad4c9873c0 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:45.781379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 20/42] 10.222.0.65 () {58 vars in 1361 bytes} [Wed Sep 14 15:10:45 2022] PUT /identity/v3/domains/default/users/ea41adfa24e148959dc896e18ec4fb9f/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:10:45.782715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:45.783050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:45.783943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:45.784417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:45.784881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:45.785786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:45.787515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:45.807873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 23/43] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Sep 14 15:10:45 2022] POST /identity/v3/roles => generated 225 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:10:45.921701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:45.997619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:46.031210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c615a-622d-4837-a921-5adc97d75008 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:46.072333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:46.072921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:46.073202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:46.073476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:46.074170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:46.076539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:46.080493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b2d39-43ea-4361-b09b-983b6ccb0504 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:46.103359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 21/44] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Sep 14 15:10:45 2022] POST /identity/v3/roles => generated 223 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:10:46.130747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c0adf-701b-449c-8207-7190ec6dec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:46.131565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c0adf-701b-449c-8207-7190ec6dec60 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:46.131987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c0adf-701b-449c-8207-7190ec6dec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:46.132364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c0adf-701b-449c-8207-7190ec6dec60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:46.133765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c0adf-701b-449c-8207-7190ec6dec60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:46.135375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c0adf-701b-449c-8207-7190ec6dec60 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:46.137371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 24/45] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:46.143079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:46.210545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:46.265700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60324-c10a-4316-b7ba-f340f9bdc4a1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:46.310712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d44c42-4afb-41af-abe8-3319677d67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:46.311329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44c42-4afb-41af-abe8-3319677d67de None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:46.311610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44c42-4afb-41af-abe8-3319677d67de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:46.311958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44c42-4afb-41af-abe8-3319677d67de None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:46.312631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d44c42-4afb-41af-abe8-3319677d67de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:46.314093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d44c42-4afb-41af-abe8-3319677d67de None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:46.344321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 22/46] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:10:46 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:10:48.003692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f81e-f6e8-4ce2-a147-949c5ee28e51 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.004251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f81e-f6e8-4ce2-a147-949c5ee28e51 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.004251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f81e-f6e8-4ce2-a147-949c5ee28e51 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.005616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 25/47] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:48.011092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddbac3-0964-4607-a0bb-f6468666a206 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.011498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddbac3-0964-4607-a0bb-f6468666a206 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.011656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddbac3-0964-4607-a0bb-f6468666a206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.031357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-bcddbac3-0964-4607-a0bb-f6468666a206 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:48.032917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-bcddbac3-0964-4607-a0bb-f6468666a206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:48.099632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 23/48] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:48.371722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619f81e-f6e8-4ce2-a147-949c5ee28e51 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:48.479659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619f81e-f6e8-4ce2-a147-949c5ee28e51 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:48.483980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0ede8-001d-4262-b175-b8dacdd05f02 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.484269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0ede8-001d-4262-b175-b8dacdd05f02 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.484566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0ede8-001d-4262-b175-b8dacdd05f02 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.486066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 24/49] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:10:48.491093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1017f-8d5d-48ca-b6f6-ce740073a415 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.491374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1017f-8d5d-48ca-b6f6-ce740073a415 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.491645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1017f-8d5d-48ca-b6f6-ce740073a415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.497449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:48.510764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c0d1017f-8d5d-48ca-b6f6-ce740073a415 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:48.512081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c0d1017f-8d5d-48ca-b6f6-ce740073a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:48.516620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:48.517254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.517532 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.517806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.529863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:10:48.534645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:48.535529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:10:48.536462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 26/50] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:10:48.541536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:48.543902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:48.591458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 25/51] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:48.644248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614f348-1e4c-4457-89f3-85b3f9642750 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:48.677457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:48.677997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.678278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.678552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.679256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:48.679511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:48.680932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:48.689443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 27/52] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:48.695152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1017f-8d5d-48ca-b6f6-ce740073a415 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:48.792130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1017f-8d5d-48ca-b6f6-ce740073a415 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:48.835592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:48.836266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.836551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.836826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] PATH_INFO: `/v3/users/ea41adfa24e148959dc896e18ec4fb9f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.837963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] RBAC: Authorizing `identity:get_user(user_id=ea41adfa24e148959dc896e18ec4fb9f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:48.839426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:48.841231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:10:48 2022] GET /identity/v3/users/ea41adfa24e148959dc896e18ec4fb9f => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:48.847254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:48.868551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:48.888082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:48.907160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:48.950154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4ad1-b8d7-4c75-a355-2ddd2ee0fe78 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:48.974057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067b72-81e4-4472-bf2f-5a39072d1e5a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:48.984502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:48.985131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:48.985508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:48.985727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:48.986834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:48.988325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:48.989893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 28/54] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:48.995555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:49.008956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:49.009594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:49.009876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:49.010150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:49.011280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:49.012767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:49.014423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:49.019754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:49.097405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec397-3ca8-4dff-9e1e-d2a3276c2694 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:49.104262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:49.120453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646e47a-e8e3-4c77-85b1-8a6709307fde None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:49.122002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:49.131746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9c26e-4971-4a03-ae98-51f0394c77eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:49.132382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c26e-4971-4a03-ae98-51f0394c77eb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:49.132662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c26e-4971-4a03-ae98-51f0394c77eb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:49.132935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c26e-4971-4a03-ae98-51f0394c77eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:49.133666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9c26e-4971-4a03-ae98-51f0394c77eb None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.domain.id=default, user.id=ea41adfa24e148959dc896e18ec4fb9f) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:49.133977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9c26e-4971-4a03-ae98-51f0394c77eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:49.135431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9c26e-4971-4a03-ae98-51f0394c77eb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:49.142111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 29/56] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Sep 14 15:10:48 2022] GET /identity/v3/role_assignments?user.id=ea41adfa24e148959dc896e18ec4fb9f&scope.domain.id=default&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:10:49.157362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7243f3c-cd06-4d14-a35d-d2f8939de66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:49.157927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7243f3c-cd06-4d14-a35d-d2f8939de66e None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:49.158205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7243f3c-cd06-4d14-a35d-d2f8939de66e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:49.158483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7243f3c-cd06-4d14-a35d-d2f8939de66e None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:49.159181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7243f3c-cd06-4d14-a35d-d2f8939de66e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:49.160724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7243f3c-cd06-4d14-a35d-d2f8939de66e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:49.190656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 28/57] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Sep 14 15:10:49 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:10:51.335575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb45e24-d960-40e9-a795-7c556967c360 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:51.336146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb45e24-d960-40e9-a795-7c556967c360 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:51.336146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb45e24-d960-40e9-a795-7c556967c360 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:51.337477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 30/58] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:51.343143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959f437-1c78-4eab-b0ba-f47b1bbdf904 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:51.343555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959f437-1c78-4eab-b0ba-f47b1bbdf904 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:51.343701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959f437-1c78-4eab-b0ba-f47b1bbdf904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:51.362272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6959f437-1c78-4eab-b0ba-f47b1bbdf904 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:51.363486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6959f437-1c78-4eab-b0ba-f47b1bbdf904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:51.430943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 29/59] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:51.695690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb45e24-d960-40e9-a795-7c556967c360 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:51.794135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb45e24-d960-40e9-a795-7c556967c360 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:51.825376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c573f-746e-4a2e-95f2-bd8ed6cb4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:51.826506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c573f-746e-4a2e-95f2-bd8ed6cb4328 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:51.826781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c573f-746e-4a2e-95f2-bd8ed6cb4328 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:51.827052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c573f-746e-4a2e-95f2-bd8ed6cb4328 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:51.828176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c573f-746e-4a2e-95f2-bd8ed6cb4328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:51.829615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c573f-746e-4a2e-95f2-bd8ed6cb4328 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:51.831145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 31/60] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:51.836691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959f437-1c78-4eab-b0ba-f47b1bbdf904 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:51.923607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:51.942920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959f437-1c78-4eab-b0ba-f47b1bbdf904 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:51.976274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e3933-fced-4f08-a24e-73c0d8905a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:51.976882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e3933-fced-4f08-a24e-73c0d8905a5a None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:51.977164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e3933-fced-4f08-a24e-73c0d8905a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:51.977441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e3933-fced-4f08-a24e-73c0d8905a5a None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:51.978106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e3933-fced-4f08-a24e-73c0d8905a5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:51.979550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e3933-fced-4f08-a24e-73c0d8905a5a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:52.005559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 30/61] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:10:51 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:10:55.383843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40409fec-2dd7-4054-afb6-ea347c1d18b9 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:55.384355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40409fec-2dd7-4054-afb6-ea347c1d18b9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:55.384461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40409fec-2dd7-4054-afb6-ea347c1d18b9 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:55.385862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 32/62] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:55.403061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76245d-e783-4b26-ae55-7e4127cb4ea0 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:55.403369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76245d-e783-4b26-ae55-7e4127cb4ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:55.403662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76245d-e783-4b26-ae55-7e4127cb4ea0 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:55.405452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 33/63] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:55.407239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a438-45f4-4755-8fe6-bad7abf61d0b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:55.408134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a438-45f4-4755-8fe6-bad7abf61d0b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:55.408612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a438-45f4-4755-8fe6-bad7abf61d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:55.413324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde463-b945-4b6f-8651-cfeb65774962 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:55.413960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde463-b945-4b6f-8651-cfeb65774962 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:55.414453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde463-b945-4b6f-8651-cfeb65774962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:55.447114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2b70a438-45f4-4755-8fe6-bad7abf61d0b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:55.451664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2b70a438-45f4-4755-8fe6-bad7abf61d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:55.452823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-7fcde463-b945-4b6f-8651-cfeb65774962 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:55.456286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7fcde463-b945-4b6f-8651-cfeb65774962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:55.516293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:55.564364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 31/64] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:55.566035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1d06c-0b40-405c-9217-edc6275fa78c None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:55.566497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1d06c-0b40-405c-9217-edc6275fa78c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:55.566958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1d06c-0b40-405c-9217-edc6275fa78c None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:55.572660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 32/65] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:55.574679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80ce59-edb3-4472-a43c-b98bb9218a63 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:55.575167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80ce59-edb3-4472-a43c-b98bb9218a63 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:55.575660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80ce59-edb3-4472-a43c-b98bb9218a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:55.617411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5b80ce59-edb3-4472-a43c-b98bb9218a63 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:55.621860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5b80ce59-edb3-4472-a43c-b98bb9218a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:55.757274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:55.760625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 34/66] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:55.766393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 33/67] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:55.868161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcde463-b945-4b6f-8651-cfeb65774962 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:55.999844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcde463-b945-4b6f-8651-cfeb65774962 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.046959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.047506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.047789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.048085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.052942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8c81-fe9f-42ff-80f7-08013268c7da None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.053486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8c81-fe9f-42ff-80f7-08013268c7da None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.053942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8c81-fe9f-42ff-80f7-08013268c7da None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.055547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 34/68] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:56.061998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9103f6-faf0-4ff9-b300-f3d796218bc9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.062558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9103f6-faf0-4ff9-b300-f3d796218bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.062841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9103f6-faf0-4ff9-b300-f3d796218bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.065536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:10:56.070526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:56.071376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:10:56.072198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 35/69] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:10:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:10:56.078652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.098858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-aa9103f6-faf0-4ff9-b300-f3d796218bc9 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:56.100132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-aa9103f6-faf0-4ff9-b300-f3d796218bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:56.108789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:56.179871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 35/70] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:10:56.179871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9103f6-faf0-4ff9-b300-f3d796218bc9 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.188010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850260cf-fcea-42a6-a2e8-95dad4263bf8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.222817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.223698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.224013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.224284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.224946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:56.225244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:56.226615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:56.236323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 36/71] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:56.237135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.289686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9103f6-faf0-4ff9-b300-f3d796218bc9 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.318851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:56.325258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d27ec-239d-41a2-b0d8-d5b06238fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.326475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d27ec-239d-41a2-b0d8-d5b06238fe2b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.326753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d27ec-239d-41a2-b0d8-d5b06238fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.327025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d27ec-239d-41a2-b0d8-d5b06238fe2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.334574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:56.339843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d27ec-239d-41a2-b0d8-d5b06238fe2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:10:56.345913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be62b0c-b59f-4f00-9826-82e4c92c62ae None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-de6d27ec-239d-41a2-b0d8-d5b06238fe2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:10:56.347086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:56.347982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:10:56.348732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 36/72] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:10:56.350075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6e018-7a3f-45e0-b1e0-f24d5fd885fb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.350075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6e018-7a3f-45e0-b1e0-f24d5fd885fb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.350075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6e018-7a3f-45e0-b1e0-f24d5fd885fb None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.351351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 37/73] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:10:56.355559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6e018-7a3f-45e0-b1e0-f24d5fd885fb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.392815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.393449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.393738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.393995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.405472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:10:56.410463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:56.411432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:10:56.412233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 37/74] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:10:56.412869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.470091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6e018-7a3f-45e0-b1e0-f24d5fd885fb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.504047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494d33f-a01d-4788-aeb5-12b8a2243eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.504840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d33f-a01d-4788-aeb5-12b8a2243eea None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.505124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d33f-a01d-4788-aeb5-12b8a2243eea None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.505402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d33f-a01d-4788-aeb5-12b8a2243eea None admin] PATH_INFO: `/v3/users/ea41adfa24e148959dc896e18ec4fb9f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.506586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494d33f-a01d-4788-aeb5-12b8a2243eea None admin] RBAC: Authorizing `identity:get_user(user_id=ea41adfa24e148959dc896e18ec4fb9f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:56.508081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494d33f-a01d-4788-aeb5-12b8a2243eea None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:56.509687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 38/75] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/users/ea41adfa24e148959dc896e18ec4fb9f => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:56.515012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04079938-c717-4275-a12b-9b75497b9284 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.515012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04079938-c717-4275-a12b-9b75497b9284 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.515012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04079938-c717-4275-a12b-9b75497b9284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.515495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d6580-17ac-4a30-ad8a-abac4961b894 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.530432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-04079938-c717-4275-a12b-9b75497b9284 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:10:56.531646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-04079938-c717-4275-a12b-9b75497b9284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:10:56.549257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.549881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.550157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.550428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.551089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:56.551391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:56.552873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:56.561574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 38/76] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:56.562376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.579990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:56.585661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:56.601956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 39/77] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:10:56.602823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04079938-c717-4275-a12b-9b75497b9284 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.675975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15418c-d1c4-45cc-a1bd-95f31cc343a7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.712655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.713270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.713552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.713829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.714223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04079938-c717-4275-a12b-9b75497b9284 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.714500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:56.714807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:56.716257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:56.724756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 39/78] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:56.725578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.757372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.758441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.758864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.759329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.760614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:56.762364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:56.764852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 40/79] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:56.770775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.816163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:56.835076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:56.844368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e394ec7-b7e2-4456-acbd-77b3df40b075 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.878425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.879035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.879309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.879577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.882862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f67b08-3a8c-455d-9020-6b7b1d7814b1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:56.917829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:56.918459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:56.918744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:56.919018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:56.932436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:56.933917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:56.935551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 41/80] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:56.936362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:56.952650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:56.954106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.025544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.035414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb17b7-1c6b-49c5-afe2-4af0cc8c7b61 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.049294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.054661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 40/81] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:10:57.054661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.071637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.072310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.072587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.072860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.074007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.075991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.077922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 42/82] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:10:56 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:57.078772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.159953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535f58e-ad4a-40d2-a3d9-644c58b12ad9 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.175331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e24145-1685-40cf-8712-1ec977a1a269 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.193249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.193854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.194132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.194404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.195049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.196515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.209914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.210540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.210818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.211086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.221824 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:10:57.223844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 41/83] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:10:57 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:10:57.226854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:10:57.228056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:10:57.228875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 43/84] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:10:57.233003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.234036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.270828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.289390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.351884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4df043-13a6-48be-a128-2dd296cdc886 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.356396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5f53-44e3-4bea-b5dc-235cca11ab82 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.391227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.392426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.392426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.392426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.394521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.395164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.395447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.395716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.396984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.398487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.400630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 44/85] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:57.401562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.488786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.490187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.515434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be633-8686-4036-8808-8c5d900bf407 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.531276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.535170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.567998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.569554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.570200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.570490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.632098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 42/86] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:10:57.636025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.671795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.674445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.750764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b24322-8201-440e-bc13-cd6bf86163f3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.792912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.801432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.802142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.802888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.803241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.804325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:57.804708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.806147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.806904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 45/87] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:10:57.808095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.821026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 43/88] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:57.821026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:57.828742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:57.943721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed79744-1d5a-48b9-ae7c-94d29b603dcc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.946157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5b4b-e9be-4ef3-b116-46429b7c3263 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:57.984603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.985636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.985989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:57.986319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.986733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:57.986961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.987134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:57.987475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:57.988315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=ea41adfa24e148959dc896e18ec4fb9f) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:57.988689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.989048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:57.990275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.990859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:57.992799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 44/89] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:57.993915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:58.004531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 46/90] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/role_assignments?user.id=ea41adfa24e148959dc896e18ec4fb9f&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:58.005798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:58.132176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:58.184228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:58.222141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832c2d-135e-46d8-ae98-55838e316b36 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:58.235054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cb1b2-5005-4d81-ad35-6d486d3945f6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:58.287687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:58.288272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:58.288552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:58.288823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:58.290092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:58.291535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:58.294899 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 45/91] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:10:57 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:58.296613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:58.298893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:58.299544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:58.299848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:58.300121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:58.301328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:58.302786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:58.304590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 47/92] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:10:58 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:58.307213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:58.485311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff2c0-25c5-454f-af9c-0c5bc2a0c105 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:58.498805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03ce6-d710-4860-9b58-3182c588478e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:58.531404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:58.532774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:58.533245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:58.533873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:58.535224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] RBAC: Adding query filter params (role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=fc80b9647e8c4c9fbc6e77f46f564e89) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:58.535746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:58.537414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:58.543909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 48/93] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:10:58 2022] GET /identity/v3/role_assignments?user.id=fc80b9647e8c4c9fbc6e77f46f564e89&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:58.545477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:58.556607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:58.572867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:58.608231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:58.608868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:58.609147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:58.609419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:58.610167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=fc80b9647e8c4c9fbc6e77f46f564e89) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:58.610477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:58.612455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:58.631041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 46/94] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:10:58 2022] GET /identity/v3/role_assignments?user.id=fc80b9647e8c4c9fbc6e77f46f564e89&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=8f49b16402cd497da63ff419948304d5 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:58.711125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117daef0-051a-4cc4-8380-a01e89209fdf None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:58.774236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:58.775145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:58.775447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:58.775763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:58.865751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:58.867150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:58.876964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:58.989396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 49/95] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:10:58.995668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:59.131144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc663-6d28-426c-8d3f-d047f42c5661 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:59.168939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51392f00-6b56-4415-b3db-cbf87c7c70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:59.170092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392f00-6b56-4415-b3db-cbf87c7c70c1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:59.170364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392f00-6b56-4415-b3db-cbf87c7c70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:59.170640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392f00-6b56-4415-b3db-cbf87c7c70c1 None admin] PATH_INFO: `/v3/projects/3e0e63324c2e432d9714153efe26ff48` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:59.171822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51392f00-6b56-4415-b3db-cbf87c7c70c1 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0e63324c2e432d9714153efe26ff48)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:59.173282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51392f00-6b56-4415-b3db-cbf87c7c70c1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:59.175394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 47/96] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:10:58 2022] GET /identity/v3/projects/3e0e63324c2e432d9714153efe26ff48 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:10:59.181386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:10:59.309473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a113327-ce57-4632-9f65-c667901dd966 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:10:59.322981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:10:59.361925 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee29e47-83f7-4d86-b94e-5eca138bd145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:10:59.362543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29e47-83f7-4d86-b94e-5eca138bd145 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:10:59.362822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29e47-83f7-4d86-b94e-5eca138bd145 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:10:59.363094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29e47-83f7-4d86-b94e-5eca138bd145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:10:59.363856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee29e47-83f7-4d86-b94e-5eca138bd145 None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=3e0e63324c2e432d9714153efe26ff48, user.id=fc80b9647e8c4c9fbc6e77f46f564e89) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:10:59.364170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee29e47-83f7-4d86-b94e-5eca138bd145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:10:59.365614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee29e47-83f7-4d86-b94e-5eca138bd145 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:10:59.376371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 50/97] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:10:59 2022] GET /identity/v3/role_assignments?user.id=fc80b9647e8c4c9fbc6e77f46f564e89&scope.project.id=3e0e63324c2e432d9714153efe26ff48&role.id=8f49b16402cd497da63ff419948304d5 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:00.060945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff757e1-08d2-48e3-a8b3-1501598a9adb None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:00.061638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff757e1-08d2-48e3-a8b3-1501598a9adb None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:00.061833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff757e1-08d2-48e3-a8b3-1501598a9adb None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:00.063158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 48/98] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:00.069472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d2695-1353-4863-9478-c4a54f6c163b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:00.069939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d2695-1353-4863-9478-c4a54f6c163b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:00.070012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d2695-1353-4863-9478-c4a54f6c163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:00.088903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0f2d2695-1353-4863-9478-c4a54f6c163b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:00.090114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0f2d2695-1353-4863-9478-c4a54f6c163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:00.177989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 51/99] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:00.408297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb8a92-1059-4769-9b51-d32bba172122 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:00.408628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb8a92-1059-4769-9b51-d32bba172122 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:00.408827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb8a92-1059-4769-9b51-d32bba172122 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:00.410449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 49/100] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:00.415773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79e53c-fcaa-4012-b44a-63fbdb48e385 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:00.416094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79e53c-fcaa-4012-b44a-63fbdb48e385 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:00.416375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79e53c-fcaa-4012-b44a-63fbdb48e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:00.439945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-af79e53c-fcaa-4012-b44a-63fbdb48e385 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:00.441269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-af79e53c-fcaa-4012-b44a-63fbdb48e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:00.529169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 52/101] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:00.611883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb8a92-1059-4769-9b51-d32bba172122 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:00.687441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:00.735801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb8a92-1059-4769-9b51-d32bba172122 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:00.776648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:00.777287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:00.777567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:00.777841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:00.793207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:00.799063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:00.800009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:00.800754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 50/102] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:00.806149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79e53c-fcaa-4012-b44a-63fbdb48e385 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:00.839562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:00.918323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79e53c-fcaa-4012-b44a-63fbdb48e385 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:00.948752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:00.976993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:00.977630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:00.977917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:00.978202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:00.978891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:00.979198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:00.980629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:00.998543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 53/103] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:01.004569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:01.173921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:01.187918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6dde-e43a-409b-80a2-33110fe7d87a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:01.194000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b673c8-48cb-4530-820f-ee3f55b48154 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:01.240315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:01.257944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:01.258597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.258879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.259155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] PATH_INFO: `/v3/users/8dfab2f226e44e0f9f42a921b8318480` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.277047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:01.277696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.278010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.278287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.284493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:01.285954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:01.287660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 51/104] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:01.293573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:01.294600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] RBAC: Authorizing `identity:get_user(user_id=8dfab2f226e44e0f9f42a921b8318480)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:01.298966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:01.301865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 54/105] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:01 2022] GET /identity/v3/users/8dfab2f226e44e0f9f42a921b8318480 => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:01.307565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:01.500125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a68b4-cfb1-4569-9298-a575f202fd21 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:01.504178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb727e-e53b-4a06-8f74-e1bad912c661 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:01.567948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5adfd-09cb-47ab-8ca6-2add75739ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:01.568585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5adfd-09cb-47ab-8ca6-2add75739ac1 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.568866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5adfd-09cb-47ab-8ca6-2add75739ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.569137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5adfd-09cb-47ab-8ca6-2add75739ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.569890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5adfd-09cb-47ab-8ca6-2add75739ac1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:01.571363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5adfd-09cb-47ab-8ca6-2add75739ac1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:01.576030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:01.576961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.577248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.577521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.611449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:01.634556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 52/106] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:11:01 2022] POST /identity/v3/projects => generated 302 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:01.670382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed8d9-0d9b-4c28-afab-b2163496e473 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.670745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed8d9-0d9b-4c28-afab-b2163496e473 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.670934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed8d9-0d9b-4c28-afab-b2163496e473 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.672633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 53/107] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:11:01.679060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2ad9-6e4e-4a12-a26f-cf967c9d978a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.679405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2ad9-6e4e-4a12-a26f-cf967c9d978a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.679604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2ad9-6e4e-4a12-a26f-cf967c9d978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.718998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-3dfd2ad9-6e4e-4a12-a26f-cf967c9d978a None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:01.721173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-3dfd2ad9-6e4e-4a12-a26f-cf967c9d978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:01.744090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:01.745592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:01.801974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:01.870427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 54/108] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:01.872235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7867c3-9130-49b2-9532-dce0192b8bfb None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.872705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7867c3-9130-49b2-9532-dce0192b8bfb None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.873159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7867c3-9130-49b2-9532-dce0192b8bfb None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.874611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 55/109] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:01.880048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d15b-24ae-490b-a5f9-ddab6c708141 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:01.880642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d15b-24ae-490b-a5f9-ddab6c708141 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:01.881120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d15b-24ae-490b-a5f9-ddab6c708141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:01.897110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 55/110] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:01.902128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-16b9d15b-24ae-490b-a5f9-ddab6c708141 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:01.904198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-16b9d15b-24ae-490b-a5f9-ddab6c708141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:01.905252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:01.968040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:01.984052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 56/111] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:02.036651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f2ecf-c6de-448c-9860-40064168da44 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:02.073865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb5fb9-5334-434d-9dc4-34ff7d1db87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:02.074770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb5fb9-5334-434d-9dc4-34ff7d1db87f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.075790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb5fb9-5334-434d-9dc4-34ff7d1db87f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.076410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb5fb9-5334-434d-9dc4-34ff7d1db87f None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.078208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb5fb9-5334-434d-9dc4-34ff7d1db87f None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:02.080172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb5fb9-5334-434d-9dc4-34ff7d1db87f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:02.082278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 56/112] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:01 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:02.088623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9d15b-24ae-490b-a5f9-ddab6c708141 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:02.205390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:02.210043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9d15b-24ae-490b-a5f9-ddab6c708141 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:02.252906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c114-6c59-4f0a-a74f-19f1f950ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:02.253886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c114-6c59-4f0a-a74f-19f1f950ab5b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.254383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c114-6c59-4f0a-a74f-19f1f950ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.254876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c114-6c59-4f0a-a74f-19f1f950ab5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.255912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7c114-6c59-4f0a-a74f-19f1f950ab5b None admin] RBAC: Adding query filter params (role.id=b0d3a8874c894c6c9357781283f21d6e, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=8dfab2f226e44e0f9f42a921b8318480) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:02.256473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7c114-6c59-4f0a-a74f-19f1f950ab5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:02.258115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7c114-6c59-4f0a-a74f-19f1f950ab5b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:02.264711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 57/113] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:02 2022] GET /identity/v3/role_assignments?user.id=8dfab2f226e44e0f9f42a921b8318480&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=b0d3a8874c894c6c9357781283f21d6e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:02.303509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f94a-f3de-41df-a816-e61fb73a098d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.304514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f94a-f3de-41df-a816-e61fb73a098d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.304998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f94a-f3de-41df-a816-e61fb73a098d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.306755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 57/114] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:02.312652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713a91-7307-46a8-9977-adf84f58b768 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.313305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713a91-7307-46a8-9977-adf84f58b768 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.313788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713a91-7307-46a8-9977-adf84f58b768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.335643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8f94a-f3de-41df-a816-e61fb73a098d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:02.349500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-87713a91-7307-46a8-9977-adf84f58b768 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:02.357196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-87713a91-7307-46a8-9977-adf84f58b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:02.509425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 58/115] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:02.510402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713a91-7307-46a8-9977-adf84f58b768 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:02.532484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8f94a-f3de-41df-a816-e61fb73a098d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:02.553050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:02.572205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:02.572967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.573399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.573744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.605085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:02.610300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:02.611194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:02.611980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 58/116] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:02.622627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:02.624801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:02.630845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713a91-7307-46a8-9977-adf84f58b768 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:02.721387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2300c2-9ed0-4cf4-bfdc-d39d239d7882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:02.722036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2300c2-9ed0-4cf4-bfdc-d39d239d7882 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.722316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2300c2-9ed0-4cf4-bfdc-d39d239d7882 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.722591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2300c2-9ed0-4cf4-bfdc-d39d239d7882 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.742785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2300c2-9ed0-4cf4-bfdc-d39d239d7882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ca2300c2-9ed0-4cf4-bfdc-d39d239d7882 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:02.749256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:02.751361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 59/117] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:02.753320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693237-1dea-44b7-981d-a681cdda69dd None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.756368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693237-1dea-44b7-981d-a681cdda69dd None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.756368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693237-1dea-44b7-981d-a681cdda69dd None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.756368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 60/118] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:02.760133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511adcf-8821-439d-873a-a21133a37c32 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.760426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511adcf-8821-439d-873a-a21133a37c32 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.760701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511adcf-8821-439d-873a-a21133a37c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.779755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-f511adcf-8821-439d-873a-a21133a37c32 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:02.781430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-f511adcf-8821-439d-873a-a21133a37c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:02.803009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beaacb-27d6-49e3-8349-536bcae8609c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:02.855956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 61/119] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:02.857530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511adcf-8821-439d-873a-a21133a37c32 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:02.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:02.870365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:02.870644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:02.870910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:02.871802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:02.872243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:02.874507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:02.895854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 59/120] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:02.904302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:02.947544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:02.985987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511adcf-8821-439d-873a-a21133a37c32 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:02.990861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:03.050563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.051180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.051521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.051794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.052493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:03.052790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.054163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.075356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 62/121] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:03.076119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.103377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508131e-9945-424e-92ce-2f3de5be5756 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.155412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.156000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.156281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.156551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] PATH_INFO: `/v3/users/ea41adfa24e148959dc896e18ec4fb9f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.162942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] RBAC: Authorizing `identity:get_user(user_id=ea41adfa24e148959dc896e18ec4fb9f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.164431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.166208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 60/122] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:02 2022] GET /identity/v3/users/ea41adfa24e148959dc896e18ec4fb9f => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:03.166803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.258466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c628-bc01-4dcf-8b85-d5d4b46448a6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.300578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.301639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.302052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.302470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.317506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:03.323557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277474fd-108a-4616-880b-3cc64cef3e97 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:03.324316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:03.325158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:03.326685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 63/123] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:03.328047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.334656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:03.342295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:03.365456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.366214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.366959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.367370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.368902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.371385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.374506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 61/124] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:03.375738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.472721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20fa2-744c-49fe-aef4-39a44ef33260 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.512615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0d3d7-1008-4ca7-b3a8-adf64349537e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.517731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.518671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.519176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.520151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.521527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.524118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.527326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 64/125] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:03.528481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.557864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.558604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.559128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.559668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.574150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:03.581002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:03.581884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:03.582658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 62/126] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:03.583332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.625426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:03.630165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:03.652299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe18c2-0ca3-44fb-9c06-c6b8821e7a46 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.688505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.689179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.689469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.689745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.690417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:03.690725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.692133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.701077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 65/127] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:03.701883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.708325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b763b-e9d2-47a1-89ca-6d2e15faeccf None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.746571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.748154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.748640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.749202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.750650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.752521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.754961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 63/128] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:03.756001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.811021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df53f6-ca23-4965-8c7f-2e8fe3deafbd None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.847523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.848370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.848785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.849071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703/users/ea41adfa24e148959dc896e18ec4fb9f/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.851015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] RBAC: Authorizing `identity:create_grant(project_id=377d1de7a4264c508b034627d8435703, user_id=ea41adfa24e148959dc896e18ec4fb9f, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.852556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.857946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:03.874006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 66/129] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:03 2022] PUT /identity/v3/projects/377d1de7a4264c508b034627d8435703/users/ea41adfa24e148959dc896e18ec4fb9f/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:03.879663 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115c632-9b92-4d37-9979-47b6f786760b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:03.880975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:03.884227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:03.951662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:03.952402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:03.952690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:03.952966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:03.953712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:03.954019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:03.955604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:03.975193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 64/130] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:03.976441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:04.011394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce061f-c587-4a95-81c9-fc10a33f2536 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:04.068639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:04.069730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.070213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.070686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.072636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:04.074410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:04.079249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 67/131] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:03 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:04.080483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:04.185777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1cbf3-c527-45da-85d4-c32163863adc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:04.204443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:04.226048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:04.227199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.227678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.228375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703/users/fc80b9647e8c4c9fbc6e77f46f564e89/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.230561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=377d1de7a4264c508b034627d8435703, user_id=fc80b9647e8c4c9fbc6e77f46f564e89, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:04.233009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:04.255995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 65/132] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:03 2022] PUT /identity/v3/projects/377d1de7a4264c508b034627d8435703/users/fc80b9647e8c4c9fbc6e77f46f564e89/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:04.257211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e46d-a047-430b-963c-5b4e09c04d0e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:04.257490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:04.301636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:04.310953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:04.311591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.311904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.312188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.313843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:04.316844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:04.318773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 68/133] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:04 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:04.326801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:04.415043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a180-5014-4601-a110-2dc83cfa36d8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:04.471289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:04.472384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.472868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.474014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.475716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:04.478201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:04.480607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 66/134] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:04 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:04.487522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:04.490764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1923d8-046c-4959-be3c-5b866f3ea569 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:04.540151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:04.560712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:04.561299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.561580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.561855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] PATH_INFO: `/v3/projects/3e0e63324c2e432d9714153efe26ff48` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.568734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0e63324c2e432d9714153efe26ff48)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:04.570231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:04.572184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 69/135] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:04 2022] GET /identity/v3/projects/3e0e63324c2e432d9714153efe26ff48 => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:04.579562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:04.648794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:04.659001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5070ce7-f4c3-4678-9fbb-34bb3ac01b70 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:04.705673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6614f-96b6-4c65-ae7c-a83ee704fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:04.706351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6614f-96b6-4c65-ae7c-a83ee704fb6d None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.706629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6614f-96b6-4c65-ae7c-a83ee704fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.706903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6614f-96b6-4c65-ae7c-a83ee704fb6d None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703/users/fc80b9647e8c4c9fbc6e77f46f564e89/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.709673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6614f-96b6-4c65-ae7c-a83ee704fb6d None admin] RBAC: Authorizing `identity:create_grant(project_id=377d1de7a4264c508b034627d8435703, user_id=fc80b9647e8c4c9fbc6e77f46f564e89, role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:04.711619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6614f-96b6-4c65-ae7c-a83ee704fb6d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:04.731360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 67/136] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:04 2022] PUT /identity/v3/projects/377d1de7a4264c508b034627d8435703/users/fc80b9647e8c4c9fbc6e77f46f564e89/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:11:04.732957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1e095-7b7b-4a07-9a71-fe8b045ca590 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.733983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1e095-7b7b-4a07-9a71-fe8b045ca590 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.734326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1e095-7b7b-4a07-9a71-fe8b045ca590 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.735840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 68/137] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:04.742814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074944-89e1-4243-a007-ef0912fb000b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.743329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074944-89e1-4243-a007-ef0912fb000b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.743609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074944-89e1-4243-a007-ef0912fb000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.748825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa26eb7-2aef-4321-821d-35d78cbb5092 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:04.778399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-60074944-89e1-4243-a007-ef0912fb000b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:04.779723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-60074944-89e1-4243-a007-ef0912fb000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:04.806393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9ed3-c812-4000-991d-5adf002f3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:04.807066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9ed3-c812-4000-991d-5adf002f3160 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:04.807399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9ed3-c812-4000-991d-5adf002f3160 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:04.807683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9ed3-c812-4000-991d-5adf002f3160 None admin] PATH_INFO: `/v3/projects/3e0e63324c2e432d9714153efe26ff48/users/fc80b9647e8c4c9fbc6e77f46f564e89/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:04.810962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9ed3-c812-4000-991d-5adf002f3160 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e0e63324c2e432d9714153efe26ff48, user_id=fc80b9647e8c4c9fbc6e77f46f564e89, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:04.812448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9ed3-c812-4000-991d-5adf002f3160 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:04.832123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 70/138] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:04 2022] PUT /identity/v3/projects/3e0e63324c2e432d9714153efe26ff48/users/fc80b9647e8c4c9fbc6e77f46f564e89/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:11:04.915947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 69/139] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:05.124088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b37de-b176-4f73-a9d7-ff0b5e46a01a None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:05.124493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b37de-b176-4f73-a9d7-ff0b5e46a01a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:05.124931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b37de-b176-4f73-a9d7-ff0b5e46a01a None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:05.126521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 71/140] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:05.132155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508823-084c-43f9-8b02-bf545cb55e23 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:05.132448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508823-084c-43f9-8b02-bf545cb55e23 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:05.132718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508823-084c-43f9-8b02-bf545cb55e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:05.154577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-26508823-084c-43f9-8b02-bf545cb55e23 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:05.155765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-26508823-084c-43f9-8b02-bf545cb55e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:05.247743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 70/141] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:05.292145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b37de-b176-4f73-a9d7-ff0b5e46a01a None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:05.372500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:05.433173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b37de-b176-4f73-a9d7-ff0b5e46a01a None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:05.476538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:05.477184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:05.477470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:05.477757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:05.478966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:05.480562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:05.487372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 72/142] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:05.492917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508823-084c-43f9-8b02-bf545cb55e23 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:05.519528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:05.651097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508823-084c-43f9-8b02-bf545cb55e23 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:05.687785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:05.688342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:05.688616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:05.688886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:05.689537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:05.690971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:05.726504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 71/143] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:05 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:11:05.790036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:05.960212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db07eb-72da-4504-b221-0c864af08b2c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:05.989145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:05.999373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:06.000383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:06.000871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:06.001388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:06.012465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:06.018681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:06.019554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:06.020521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:06.022872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 73/144] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:06.029311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:06.131481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:06.181225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418178-bd24-4a67-8447-b31d85b5e6ae None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:06.239021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:06.239897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:06.240385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:06.240826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:06.241655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:06.242106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:06.243639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:06.255613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 72/145] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:06.264954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:06.380585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb214c4-87e8-4fcb-97ed-bd6cc9a90e69 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:06.425056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:06.425935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:06.426365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:06.426863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] PATH_INFO: `/v3/users/8dfab2f226e44e0f9f42a921b8318480` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:06.428563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=8dfab2f226e44e0f9f42a921b8318480)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:06.430280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:06.432290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 74/146] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:06 2022] GET /identity/v3/users/8dfab2f226e44e0f9f42a921b8318480 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:06.439232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:06.579107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad021e-df9e-44a5-845c-75b7b2ea2098 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:06.623991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:06.632399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8e3d7-3748-43b9-a563-360badde0d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:06.633657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e3d7-3748-43b9-a563-360badde0d88 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:06.633949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e3d7-3748-43b9-a563-360badde0d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:06.634231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e3d7-3748-43b9-a563-360badde0d88 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:06.637235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8e3d7-3748-43b9-a563-360badde0d88 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:06.638821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8e3d7-3748-43b9-a563-360badde0d88 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:06.640637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 73/147] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:06 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:06.646452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:06.717267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:06.771359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a89816-85fc-42a6-b6cb-b0d3a0d3c0d8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:06.816030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612cbeb-9152-478c-ac2f-00213737bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:06.816764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cbeb-9152-478c-ac2f-00213737bd56 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:06.817051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cbeb-9152-478c-ac2f-00213737bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:06.817327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cbeb-9152-478c-ac2f-00213737bd56 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703/users/8dfab2f226e44e0f9f42a921b8318480/roles/b0d3a8874c894c6c9357781283f21d6e` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:06.819327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612cbeb-9152-478c-ac2f-00213737bd56 None admin] RBAC: Authorizing `identity:create_grant(project_id=377d1de7a4264c508b034627d8435703, user_id=8dfab2f226e44e0f9f42a921b8318480, role_id=b0d3a8874c894c6c9357781283f21d6e)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:06.820814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612cbeb-9152-478c-ac2f-00213737bd56 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:06.848256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 75/148] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:06 2022] PUT /identity/v3/projects/377d1de7a4264c508b034627d8435703/users/8dfab2f226e44e0f9f42a921b8318480/roles/b0d3a8874c894c6c9357781283f21d6e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:07.107287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620598a-df5d-4587-81ba-8ef96ea9e454 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:07.107494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620598a-df5d-4587-81ba-8ef96ea9e454 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:07.107923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620598a-df5d-4587-81ba-8ef96ea9e454 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:07.109441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 74/149] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:07.115209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c172d67-653a-4f19-9874-a0d50db2b52c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:07.115498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c172d67-653a-4f19-9874-a0d50db2b52c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:07.115840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c172d67-653a-4f19-9874-a0d50db2b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:07.135277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4c172d67-653a-4f19-9874-a0d50db2b52c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:07.136598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4c172d67-653a-4f19-9874-a0d50db2b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:07.252167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 76/150] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:07.433203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e82ed-c171-48e9-bc09-473fec3e8d23 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:07.433610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e82ed-c171-48e9-bc09-473fec3e8d23 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:07.433788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e82ed-c171-48e9-bc09-473fec3e8d23 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:07.435181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 75/151] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:07.445523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cb5c2-e845-4955-aa64-497da03ea2a7 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:07.445996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cb5c2-e845-4955-aa64-497da03ea2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:07.446088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cb5c2-e845-4955-aa64-497da03ea2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:07.476129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-359cb5c2-e845-4955-aa64-497da03ea2a7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:07.477342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-359cb5c2-e845-4955-aa64-497da03ea2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:07.539780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:07.569132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 77/152] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:07.856505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e82ed-c171-48e9-bc09-473fec3e8d23 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:07.979365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cb5c2-e845-4955-aa64-497da03ea2a7 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:08.001639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e82ed-c171-48e9-bc09-473fec3e8d23 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:08.083546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:08.084224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:08.084501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:08.084770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:08.101655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:08.117708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:08.118588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:08.119333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 76/153] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:08.124745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cb5c2-e845-4955-aa64-497da03ea2a7 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:08.127485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:08.219758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:08.220420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:08.220697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:08.220967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:08.243160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:08.253401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:08.254306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:08.255285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:08.257318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 78/154] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:08.265720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:08.269429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:08.351554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:08.361699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134448e-f288-49d9-8520-b92d42cc59a1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:08.437336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:08.437909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:08.438189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:08.438331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b51b2-31d2-437d-a944-5fe4866c6853 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:08.438470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:08.439143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:08.439441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:08.440958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:08.459360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 77/155] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:08.465371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:08.497022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:08.498005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:08.498495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:08.498967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:08.500142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:08.500458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:08.502104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:08.517563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 79/156] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:08.528027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:08.680241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:08.690098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543bb5e-2729-46bd-99e2-42ed88ab76cc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:08.767896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609e27-0fe3-41a6-89dc-6a81867d76d5 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:08.786590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:08.787309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:08.787590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:08.787881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:08.789286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:08.790748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:08.794629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 80/157] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:08 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:08.811077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:08.833848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:08.864923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:08.865564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:08.865840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:08.866110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] PATH_INFO: `/v3/users/ea41adfa24e148959dc896e18ec4fb9f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:08.867262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] RBAC: Authorizing `identity:get_user(user_id=ea41adfa24e148959dc896e18ec4fb9f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:08.868766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:08.870575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 78/158] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:08 2022] GET /identity/v3/users/ea41adfa24e148959dc896e18ec4fb9f => generated 247 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:08.876326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:09.066059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a26e8-dc2b-4233-ac7c-2c2a77f44878 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:09.115019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36113363-ed96-4360-a950-a134ebfd69ea None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:09.164552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62804506-605b-4352-b495-8a15c6c4ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:09.165197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62804506-605b-4352-b495-8a15c6c4ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:09.165455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62804506-605b-4352-b495-8a15c6c4ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:09.165728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62804506-605b-4352-b495-8a15c6c4ce75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:09.171503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913a55-d3f8-440d-93ba-51e14e1f86d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:09.172281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913a55-d3f8-440d-93ba-51e14e1f86d4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:09.172574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913a55-d3f8-440d-93ba-51e14e1f86d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:09.173008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913a55-d3f8-440d-93ba-51e14e1f86d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:09.255887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:09.281291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:09.299282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913a55-d3f8-440d-93ba-51e14e1f86d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:09.300813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913a55-d3f8-440d-93ba-51e14e1f86d4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:09.352930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62804506-605b-4352-b495-8a15c6c4ce75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:09.354309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62804506-605b-4352-b495-8a15c6c4ce75 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:09.506417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 79/159] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:09.507798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff292b-e84c-42d6-a97f-08e6c4a51598 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:09.508112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff292b-e84c-42d6-a97f-08e6c4a51598 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:09.508387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff292b-e84c-42d6-a97f-08e6c4a51598 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:09.509868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 80/160] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:09.510805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8807-4e43-4852-a663-fbe51968b079 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:09.513577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8807-4e43-4852-a663-fbe51968b079 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:09.513974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8807-4e43-4852-a663-fbe51968b079 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:09.515358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 81/161] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:09.516056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e8807-4e43-4852-a663-fbe51968b079 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:09.545223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 81/162] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:11:09.546495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9fba-f60b-4384-bb07-1c3c9c346c8f None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:09.546780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9fba-f60b-4384-bb07-1c3c9c346c8f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:09.547049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9fba-f60b-4384-bb07-1c3c9c346c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:09.577459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-910e9fba-f60b-4384-bb07-1c3c9c346c8f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:09.578720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-910e9fba-f60b-4384-bb07-1c3c9c346c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:09.732199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:09.740672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:09.750195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e8807-4e43-4852-a663-fbe51968b079 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:09.765023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 82/163] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:09.765023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34d3f1-71ac-4575-a872-790e7bedc36e None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:09.765023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34d3f1-71ac-4575-a872-790e7bedc36e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:09.765023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34d3f1-71ac-4575-a872-790e7bedc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:09.805350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:09.806482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:09.807007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:09.807478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:09.809041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:09.811396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:09.813688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 82/164] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:09 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:09.814688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:09.819797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-5c34d3f1-71ac-4575-a872-790e7bedc36e None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:09.819797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5c34d3f1-71ac-4575-a872-790e7bedc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:09.967962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9fbde-a3cf-473e-ad34-16495c0ebc85 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:10.023610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:10.025023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:10.025840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:10.026323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:10.027654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:10.030307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:10.036332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 83/165] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:09 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:10.037390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:10.047491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 83/166] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:10.061740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34d3f1-71ac-4575-a872-790e7bedc36e None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:10.086431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:10.213678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15818031-2797-457a-ab6a-a7ed7f52f94c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:10.265030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:10.266014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:10.266493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:10.266972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:10.267932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=ea41adfa24e148959dc896e18ec4fb9f) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:10.268430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:10.270234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:10.283358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 84/167] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:10 2022] GET /identity/v3/role_assignments?user.id=ea41adfa24e148959dc896e18ec4fb9f&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:10.336840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34d3f1-71ac-4575-a872-790e7bedc36e None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:10.374932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:10.388676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:10.389298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:10.389569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:10.389843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:10.390591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=fc80b9647e8c4c9fbc6e77f46f564e89) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:10.390897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:10.392397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:10.399410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 84/168] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:10 2022] GET /identity/v3/role_assignments?user.id=fc80b9647e8c4c9fbc6e77f46f564e89&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=8f49b16402cd497da63ff419948304d5 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:10.403071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:10.563917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:10.577346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f691d84-069f-4926-922f-72e88ddcfde3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:10.637118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70add11a-45da-4711-9b5d-b309333484bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:10.638788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70add11a-45da-4711-9b5d-b309333484bb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:10.639279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70add11a-45da-4711-9b5d-b309333484bb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:10.640006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70add11a-45da-4711-9b5d-b309333484bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:10.652299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70add11a-45da-4711-9b5d-b309333484bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-70add11a-45da-4711-9b5d-b309333484bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:10.658245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:10.659201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:10.660082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:10.662421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 85/169] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:10.668415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:10.812510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec84798-5676-4dfb-8fe8-27d1abac067b None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:10.813215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec84798-5676-4dfb-8fe8-27d1abac067b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:10.813688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec84798-5676-4dfb-8fe8-27d1abac067b None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:10.815769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 86/170] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:10.822099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4757-8b45-4bca-b8f5-b69b10a803d3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:10.822674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4757-8b45-4bca-b8f5-b69b10a803d3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:10.823136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4757-8b45-4bca-b8f5-b69b10a803d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:10.845294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aef26-c4aa-4ed2-93a4-dfa5135ff6ec None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:10.846259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-777c4757-8b45-4bca-b8f5-b69b10a803d3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:10.848975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-777c4757-8b45-4bca-b8f5-b69b10a803d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:10.922015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:10.923040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:10.923526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:10.924020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:10.924973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:10.925477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:10.927173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:10.936240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 87/171] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:10.941375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4757-8b45-4bca-b8f5-b69b10a803d3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:10.946306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 85/172] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:10.952498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.059170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.095308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.124273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1548e74-96aa-460e-b563-4eff32150041 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:11.125397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4757-8b45-4bca-b8f5-b69b10a803d3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:11.167742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:11.169398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.170619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.171068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.182738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:11.183732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:11.185046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.185400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.185746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.187038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:11.188591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:11.190901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 86/173] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:10 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:11.194575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:11.195472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:11.197618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:11.198397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.200571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 88/174] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:11.206174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.339513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd331-bdac-47db-bd73-8d48d370eec1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:11.347303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b010ba-6f3c-4612-b687-d5aa1eb2afe4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:11.366430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.386225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112c31-a847-4fd1-b821-df3ebe21b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:11.387326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112c31-a847-4fd1-b821-df3ebe21b828 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.387326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112c31-a847-4fd1-b821-df3ebe21b828 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.387567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112c31-a847-4fd1-b821-df3ebe21b828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.401633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca206cd-f133-4c33-911c-a3e24745b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:11.402797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca206cd-f133-4c33-911c-a3e24745b8ba None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.403797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca206cd-f133-4c33-911c-a3e24745b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.404311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca206cd-f133-4c33-911c-a3e24745b8ba None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.405201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca206cd-f133-4c33-911c-a3e24745b8ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:11.405713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca206cd-f133-4c33-911c-a3e24745b8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:11.407359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca206cd-f133-4c33-911c-a3e24745b8ba None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:11.416401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 89/175] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:11.418008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e9ec-5198-48d2-8384-ae0403de3f8d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.418487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e9ec-5198-48d2-8384-ae0403de3f8d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.419587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e9ec-5198-48d2-8384-ae0403de3f8d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.421078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 90/176] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:11.422908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e9ec-5198-48d2-8384-ae0403de3f8d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.428135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.468365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9112c31-a847-4fd1-b821-df3ebe21b828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:11.469857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9112c31-a847-4fd1-b821-df3ebe21b828 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:11.534035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e9ec-5198-48d2-8384-ae0403de3f8d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:11.567632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a49e3-f9d6-46cc-8c8d-3ef5b263b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:11.568295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a49e3-f9d6-46cc-8c8d-3ef5b263b4de None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.568574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a49e3-f9d6-46cc-8c8d-3ef5b263b4de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.568849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a49e3-f9d6-46cc-8c8d-3ef5b263b4de None admin] PATH_INFO: `/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.569970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a49e3-f9d6-46cc-8c8d-3ef5b263b4de None admin] RBAC: Authorizing `identity:get_user(user_id=fc80b9647e8c4c9fbc6e77f46f564e89)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:11.571426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a49e3-f9d6-46cc-8c8d-3ef5b263b4de None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:11.573141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 91/177] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:11 2022] GET /identity/v3/users/fc80b9647e8c4c9fbc6e77f46f564e89 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:11.576976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94707dc8-690c-42bf-b092-82b8e6b2166d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.577223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 87/178] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:11:11.577595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94707dc8-690c-42bf-b092-82b8e6b2166d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.577878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94707dc8-690c-42bf-b092-82b8e6b2166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.578457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145730f-2f89-4bbb-8015-62018331c084 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.578737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145730f-2f89-4bbb-8015-62018331c084 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.579007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145730f-2f89-4bbb-8015-62018331c084 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.580411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 88/179] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:11.581491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4e9c1-6c9a-4b5c-b3fc-b4aea08656b8 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.581653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4e9c1-6c9a-4b5c-b3fc-b4aea08656b8 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.581908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4e9c1-6c9a-4b5c-b3fc-b4aea08656b8 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.583079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 89/180] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:11.583765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4e9c1-6c9a-4b5c-b3fc-b4aea08656b8 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.604128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-94707dc8-690c-42bf-b092-82b8e6b2166d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:11.605693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-94707dc8-690c-42bf-b092-82b8e6b2166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:11.605811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.670764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.675962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 92/181] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:11.676841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94707dc8-690c-42bf-b092-82b8e6b2166d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.691644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4e9c1-6c9a-4b5c-b3fc-b4aea08656b8 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:11.730367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6dcf5-2a85-477d-9fe9-3c2b105e4dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:11.732011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6dcf5-2a85-477d-9fe9-3c2b105e4dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.732326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6dcf5-2a85-477d-9fe9-3c2b105e4dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.732682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6dcf5-2a85-477d-9fe9-3c2b105e4dd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.744954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6dcf5-2a85-477d-9fe9-3c2b105e4dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-e7f6dcf5-2a85-477d-9fe9-3c2b105e4dd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:11.750114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:11.750994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:11.752541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 90/182] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:11.753224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347652ea-9c97-4eb8-a7f6-c50fe218d0c3 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.753224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347652ea-9c97-4eb8-a7f6-c50fe218d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.753551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347652ea-9c97-4eb8-a7f6-c50fe218d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.772092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-347652ea-9c97-4eb8-a7f6-c50fe218d0c3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:11.773277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-347652ea-9c97-4eb8-a7f6-c50fe218d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:11.798252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94707dc8-690c-42bf-b092-82b8e6b2166d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:11.837066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:11.837983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.838266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.838537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] PATH_INFO: `/v3/projects/3e0e63324c2e432d9714153efe26ff48` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.839666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] RBAC: Authorizing `identity:get_project(project_id=3e0e63324c2e432d9714153efe26ff48)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:11.841777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:11.843671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 93/183] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:11 2022] GET /identity/v3/projects/3e0e63324c2e432d9714153efe26ff48 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:11.845210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 91/184] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:11.846415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9989a-6242-48f7-a5d9-6a87e06b8dd2 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:11.846695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9989a-6242-48f7-a5d9-6a87e06b8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:11.846962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9989a-6242-48f7-a5d9-6a87e06b8dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:11.856078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.871521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-14a9989a-6242-48f7-a5d9-6a87e06b8dd2 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:11.872775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-14a9989a-6242-48f7-a5d9-6a87e06b8dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:11.875793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.928240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:11.956857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 92/185] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:11.957980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9989a-6242-48f7-a5d9-6a87e06b8dd2 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:11.972905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d30d-ff87-4061-9a99-430563373a2b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.017143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.019942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.021064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.021529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.071798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9989a-6242-48f7-a5d9-6a87e06b8dd2 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.102453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.104539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.118097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.118635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.118907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.119175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.119863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:12.120175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.122839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.133965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 93/186] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:12.136677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.142304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.185823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.223360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 94/187] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:12.224628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.253085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951188e-3d72-412a-9c2a-84e45fbf9406 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.286694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.287296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.287574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.287875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.288608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=3e0e63324c2e432d9714153efe26ff48, user.id=fc80b9647e8c4c9fbc6e77f46f564e89) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:12.288918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.290350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.297253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 94/188] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/role_assignments?user.id=fc80b9647e8c4c9fbc6e77f46f564e89&scope.project.id=3e0e63324c2e432d9714153efe26ff48&role.id=8f49b16402cd497da63ff419948304d5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:12.299022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.350032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6c6f-3a44-4b4a-8c40-a2bdf69ec129 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.373453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.393801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.394449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.394727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.394994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.407322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:12.412621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:12.413579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:12.416813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:12.417413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2521e-1097-4e65-846a-b91d4ceaa54c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.417485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 95/189] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:12.417485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.451093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.458105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f437-c632-47b6-b607-040836935bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.458761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f437-c632-47b6-b607-040836935bed None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.459034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f437-c632-47b6-b607-040836935bed None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.459300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f437-c632-47b6-b607-040836935bed None admin] PATH_INFO: `/v3/users/8dfab2f226e44e0f9f42a921b8318480` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.460522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1f437-c632-47b6-b607-040836935bed None admin] RBAC: Authorizing `identity:get_user(user_id=8dfab2f226e44e0f9f42a921b8318480)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.462044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1f437-c632-47b6-b607-040836935bed None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.463894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 95/190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/users/8dfab2f226e44e0f9f42a921b8318480 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:12.468827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f437-c632-47b6-b607-040836935bed None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.534078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865077-a39f-40ab-9c14-67f972089b7d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.577461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.578090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.578368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.578637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.587435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f437-c632-47b6-b607-040836935bed None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.588912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:12.593763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:12.594695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 96/191] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:12.596799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.629033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.629578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.629854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.630119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.631212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.632708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.634281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 96/192] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:12.635040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.637639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.686010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.699219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6caf8-caea-41c1-a072-48edde70b47a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.732438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.733054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.733330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.733596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.734720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.736196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.736936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd7f38-337c-49b6-86da-2a94dc5db170 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.737832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 97/193] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:12.738597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.771981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.772598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.772874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.773142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.773806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:12.774103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.775730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.783870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 97/194] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:12.783870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.843575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2419fa8-40f4-402b-af76-95429c01a020 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.848634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.876942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.877692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.878073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.878443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.889227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114c641-da1e-4091-a7a7-4f017c4d4447 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:12.903854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:12.925723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:12.926331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:12.926611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:12.926878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:12.927550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:12.927879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.929249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:12.937169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 98/195] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:12.937953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:12.952205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:12.953668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.037751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082903b7-8273-4514-be5b-8e61eabf1d9a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.059182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 98/196] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:13.060211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.064535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.074540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.075202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.075475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.075745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.076439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.077876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.099211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 99/197] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:12 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:13.100156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.125028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.179535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1784e-951c-4d91-9ed9-915a6ff36a97 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.220074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.220703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.221030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.221309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.222061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] RBAC: Adding query filter params (role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=fc80b9647e8c4c9fbc6e77f46f564e89) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:13.222373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.224188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.239864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 99/198] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/role_assignments?user.id=fc80b9647e8c4c9fbc6e77f46f564e89&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:13.239864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.240225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b0d67-268d-40db-bf10-6282ccb4aedb None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.282711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.283464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.283745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.284147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] PATH_INFO: `/v3/users/b19527de69234d1f848b2ee6f5c5a7e7` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.303486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] RBAC: Authorizing `identity:get_user(user_id=b19527de69234d1f848b2ee6f5c5a7e7)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.305016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.307128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 100/199] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/users/b19527de69234d1f848b2ee6f5c5a7e7 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:13.313045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.368848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434991b1-f34d-4bf2-814a-77373a4c0832 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.376772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.406447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.431084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.431659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.432024 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.432298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] PATH_INFO: `/v3/users/b19527de69234d1f848b2ee6f5c5a7e7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.433885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=b19527de69234d1f848b2ee6f5c5a7e7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.435361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.437189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 100/200] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/users/b19527de69234d1f848b2ee6f5c5a7e7 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:13.437817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.463714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d76cf-9052-49a5-bdee-cd088a8373bd None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.508833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.509657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.509937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.510209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.512174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.514174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.516107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 101/201] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:13.516739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.577962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae1b53-5cf5-47e0-82f8-f0ba0895b0a7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.620233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.621189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.621715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.622838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.643545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b5ec-6c2d-472c-9746-fe0a72e975f3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.655055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.682725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.683303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.683587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.683881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.703994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.704740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.706680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.757728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.759167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.819224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 101/202] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:13.820574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.874490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 102/203] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:13.875225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:13.885463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.933731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd27ba8-732f-47b4-b2ca-b6ba10e13fb7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.960708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:13.972206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:13.973325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:13.973945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:13.974432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:13.975445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] RBAC: Adding query filter params (role.id=b0d3a8874c894c6c9357781283f21d6e, scope.project.id=377d1de7a4264c508b034627d8435703, user.id=8dfab2f226e44e0f9f42a921b8318480) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:13.976049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:13.977725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:13.992093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa237628-2a65-4a39-8297-c17bd58f99fc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:13.992586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 102/204] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/role_assignments?user.id=8dfab2f226e44e0f9f42a921b8318480&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=b0d3a8874c894c6c9357781283f21d6e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:13.993785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:14.053355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:14.054006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:14.054284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:14.054553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:14.055944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:14.057426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:14.060781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 103/205] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:14.068920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:14.188330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:14.204984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98fa57-a674-49a9-861c-bbdb90c047d4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:14.236454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90902-d5ca-4cac-8275-8eb1967609ba None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:14.261012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:14.262015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:14.263093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:14.263564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:14.265621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:14.267469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:14.269325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 103/206] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:13 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:14.277400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:14.284223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae947-c790-4243-bd7a-9f84d4caaab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:14.284837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae947-c790-4243-bd7a-9f84d4caaab2 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:14.285111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae947-c790-4243-bd7a-9f84d4caaab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:14.285375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae947-c790-4243-bd7a-9f84d4caaab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:14.286112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ae947-c790-4243-bd7a-9f84d4caaab2 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=b19527de69234d1f848b2ee6f5c5a7e7) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:14.286421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ae947-c790-4243-bd7a-9f84d4caaab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:14.288073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ae947-c790-4243-bd7a-9f84d4caaab2 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:14.298719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 104/207] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:14 2022] GET /identity/v3/role_assignments?user.id=b19527de69234d1f848b2ee6f5c5a7e7&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:14.318806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:14.425951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78e35-7c14-4e55-9d6c-27b68f713c16 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:14.469465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea8977-27c9-476a-b982-911d78e8a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:14.470379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8977-27c9-476a-b982-911d78e8a4af None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:14.470903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8977-27c9-476a-b982-911d78e8a4af None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:14.471348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8977-27c9-476a-b982-911d78e8a4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:14.472319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea8977-27c9-476a-b982-911d78e8a4af None admin] RBAC: Adding query filter params (role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=b19527de69234d1f848b2ee6f5c5a7e7) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:14.472806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea8977-27c9-476a-b982-911d78e8a4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:14.474487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea8977-27c9-476a-b982-911d78e8a4af None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:14.484087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 104/208] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:14 2022] GET /identity/v3/role_assignments?user.id=b19527de69234d1f848b2ee6f5c5a7e7&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:15.695100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d297-16a1-4e16-8d9d-33df07641984 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:15.695609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d297-16a1-4e16-8d9d-33df07641984 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:15.695609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d297-16a1-4e16-8d9d-33df07641984 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:15.697192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 105/209] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:15.702676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3c5b-4c2b-4c28-b662-ef069b7f47cc None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:15.703117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3c5b-4c2b-4c28-b662-ef069b7f47cc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:15.703288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3c5b-4c2b-4c28-b662-ef069b7f47cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:15.723746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8edd3c5b-4c2b-4c28-b662-ef069b7f47cc None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:15.724957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8edd3c5b-4c2b-4c28-b662-ef069b7f47cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:15.782181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230c1c0-52de-4f99-a87e-bf8e63ad1096 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:15.782526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230c1c0-52de-4f99-a87e-bf8e63ad1096 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:15.782731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230c1c0-52de-4f99-a87e-bf8e63ad1096 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:15.784361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 106/210] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:15.789533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6fcc0-5eaf-4757-a1c3-03568f75fc65 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:15.789815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6fcc0-5eaf-4757-a1c3-03568f75fc65 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:15.790088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6fcc0-5eaf-4757-a1c3-03568f75fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:15.796332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 105/211] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:15.808747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-34e6fcc0-5eaf-4757-a1c3-03568f75fc65 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:15.810511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-34e6fcc0-5eaf-4757-a1c3-03568f75fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:15.881715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 107/212] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:16.078108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3c5b-4c2b-4c28-b662-ef069b7f47cc None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:16.094021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:16.150671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6fcc0-5eaf-4757-a1c3-03568f75fc65 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:16.182529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3c5b-4c2b-4c28-b662-ef069b7f47cc None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:16.217631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:16.218270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.218545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.218816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.225764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:16.229550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:16.235006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:16.235927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:16.237149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 106/213] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:16.242135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:16.264779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6fcc0-5eaf-4757-a1c3-03568f75fc65 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:16.302140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:16.303162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.303650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.304167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.305480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:16.307123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:16.308962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 108/214] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:16.317198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:16.320170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:16.348726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63f9f-035f-4fc3-b2b8-44da15d9ce8c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:16.384131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:16.384740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.385021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.385292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.385959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:16.386257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:16.388338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:16.402153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 107/215] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:16.403723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:16.448960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b001e4e-b726-476f-a885-09b2a725bd79 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:16.489689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a0641-82e7-46e4-b7f7-94e10a851388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:16.490626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a0641-82e7-46e4-b7f7-94e10a851388 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.491083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a0641-82e7-46e4-b7f7-94e10a851388 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.491528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a0641-82e7-46e4-b7f7-94e10a851388 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.492398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a0641-82e7-46e4-b7f7-94e10a851388 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:16.494433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a0641-82e7-46e4-b7f7-94e10a851388 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:16.506976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:16.524149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067eb94-5786-426d-a4ba-070d458c51ca None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:16.532216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 109/216] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:16 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:16.539828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b014d8-3231-44db-ad2c-08fd7518f1eb None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.540263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b014d8-3231-44db-ad2c-08fd7518f1eb None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.540528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b014d8-3231-44db-ad2c-08fd7518f1eb None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.542165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 110/217] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:16.548123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952727b-265f-43b6-af96-33d953315dc0 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.548717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952727b-265f-43b6-af96-33d953315dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.548985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952727b-265f-43b6-af96-33d953315dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.568392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-7952727b-265f-43b6-af96-33d953315dc0 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:16.569666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7952727b-265f-43b6-af96-33d953315dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:16.582706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:16.584044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.584530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.585242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] PATH_INFO: `/v3/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.590494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:16.613425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=405b45bf0e5f4e9cbb2e29e6b35f8ce4)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:16.615401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:16.621569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 108/218] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:16 2022] GET /identity/v3/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:16.630017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:16.672413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 111/219] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:16.758589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7fbb-f0ec-483f-8801-15799b2b0ef8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:16.795654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:16.796667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.797172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.797646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.821683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbbfc0-4095-4604-8992-a0c3480cdd06 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.822184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbbfc0-4095-4604-8992-a0c3480cdd06 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.822259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbbfc0-4095-4604-8992-a0c3480cdd06 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.823838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 112/220] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:16.829926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994cef-b4af-4ec0-8584-08f44960c2f2 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:16.830211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994cef-b4af-4ec0-8584-08f44960c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:16.830479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994cef-b4af-4ec0-8584-08f44960c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:16.851304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-48994cef-b4af-4ec0-8584-08f44960c2f2 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:16.852525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-48994cef-b4af-4ec0-8584-08f44960c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:16.868209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:16.879299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:16.880832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:16.945918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 113/221] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:16.947233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994cef-b4af-4ec0-8584-08f44960c2f2 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.019498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:17.022858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 109/222] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:17.030185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.076513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994cef-b4af-4ec0-8584-08f44960c2f2 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.124368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.125405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.125745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.126082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.138398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:17.144217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:17.145116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:17.145895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 114/223] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:17.151568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.156130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:17.166574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027676d-827f-4753-b7ea-cb1c08c845eb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.217861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.219162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.219672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.220170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.222091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:17.224122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:17.227121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 110/224] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:17.233359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.282115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2ff8-ef7e-4659-b267-eb755ae5e5ee None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.301961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:17.325113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.325723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.325997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.326266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.327350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:17.327655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:17.329590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:17.339790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 115/225] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:17.341145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.355013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8f169-2043-4b3d-a6bc-91c43e356b79 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.391209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.392256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.392740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.393247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.394356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=405b45bf0e5f4e9cbb2e29e6b35f8ce4) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:17.394874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:17.396681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:17.404228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 111/226] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/role_assignments?user.id=405b45bf0e5f4e9cbb2e29e6b35f8ce4&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=8f49b16402cd497da63ff419948304d5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:17.406583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.460263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:17.478379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa599a-f75f-4deb-9d5e-9ac4c44c9f5f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.518450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.518812 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.519078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.519348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.539294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:17.549561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:17.550493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:17.551299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:17.558359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 116/227] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:17.560980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26301b-0a23-48b3-a4fd-1cf96e7ae40c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.565546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.630059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:17.639397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.641038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.641469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.641909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] PATH_INFO: `/v3/users/b19527de69234d1f848b2ee6f5c5a7e7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.643709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=b19527de69234d1f848b2ee6f5c5a7e7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:17.645958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:17.647863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 112/228] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/users/b19527de69234d1f848b2ee6f5c5a7e7 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:17.656381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.718558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4c00-ee15-4d2f-9370-27782378e065 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.759719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.768404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.768688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.768999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.769823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:17.770025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:17.771433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:17.787880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:17.789060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 117/229] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:17.794675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.796866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b9596-46d4-45e0-a993-b202fa150cf0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:17.838531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:17.839420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:17.839869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:17.840286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:17.842152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:17.843739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:17.846604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 113/230] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:17.854652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:17.978355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:17.988813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7c2ea-49ae-4d86-b33e-1fce83db5083 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:18.037781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:18.038351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:18.039406 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:18.039671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] PATH_INFO: `/v3/users/b19527de69234d1f848b2ee6f5c5a7e7` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:18.041353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] RBAC: Authorizing `identity:get_user(user_id=b19527de69234d1f848b2ee6f5c5a7e7)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:18.042782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:18.044439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 118/231] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:17 2022] GET /identity/v3/users/b19527de69234d1f848b2ee6f5c5a7e7 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:18.050393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44812ff-f6fb-48ca-8d9a-b10f5b39aa72 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:18.054217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:18.116647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:18.117323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:18.117605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:18.117878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/b19527de69234d1f848b2ee6f5c5a7e7/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:18.120187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b94d5a64b4f44628f8a822fa03995e6, user_id=b19527de69234d1f848b2ee6f5c5a7e7, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:18.122271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:18.144650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 114/232] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:17 2022] PUT /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/b19527de69234d1f848b2ee6f5c5a7e7/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:11:18.207018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17aac2-0175-4edf-82c4-23504f85d4aa None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:18.261802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e93cb-e673-400c-8def-f59a6767f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:18.263023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e93cb-e673-400c-8def-f59a6767f386 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:18.263305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e93cb-e673-400c-8def-f59a6767f386 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:18.263629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e93cb-e673-400c-8def-f59a6767f386 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:18.268219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e93cb-e673-400c-8def-f59a6767f386 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:18.269729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e93cb-e673-400c-8def-f59a6767f386 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:18.271851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 119/233] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:18 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:18.277948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:18.311448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:18.408281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3290d9d-77bf-48c9-b81a-a863293468c6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:18.445314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2cf6-7cc0-46cb-8281-20cc1c1f7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:18.445983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2cf6-7cc0-46cb-8281-20cc1c1f7cce None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:18.446259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2cf6-7cc0-46cb-8281-20cc1c1f7cce None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:18.446516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2cf6-7cc0-46cb-8281-20cc1c1f7cce None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/b19527de69234d1f848b2ee6f5c5a7e7/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:18.448715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f2cf6-7cc0-46cb-8281-20cc1c1f7cce None admin] RBAC: Authorizing `identity:create_grant(project_id=1b94d5a64b4f44628f8a822fa03995e6, user_id=b19527de69234d1f848b2ee6f5c5a7e7, role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:18.450749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f2cf6-7cc0-46cb-8281-20cc1c1f7cce None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:18.468255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 115/234] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:18 2022] PUT /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/b19527de69234d1f848b2ee6f5c5a7e7/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:19.358076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315e433-e478-4d32-8939-3d7dd8c9d84c None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:19.358591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315e433-e478-4d32-8939-3d7dd8c9d84c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:19.358591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315e433-e478-4d32-8939-3d7dd8c9d84c None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:19.360000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 120/235] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:19.365387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89b8f-d7a8-4afe-aa5f-c237d6fc3fd9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:19.365864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89b8f-d7a8-4afe-aa5f-c237d6fc3fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:19.366076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89b8f-d7a8-4afe-aa5f-c237d6fc3fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:19.385615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-00d89b8f-d7a8-4afe-aa5f-c237d6fc3fd9 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:19.386794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-00d89b8f-d7a8-4afe-aa5f-c237d6fc3fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:19.458501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 116/236] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:19.632117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063fa68-97c2-4cb9-8204-c6a24b835469 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:19.632405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063fa68-97c2-4cb9-8204-c6a24b835469 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:19.632568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063fa68-97c2-4cb9-8204-c6a24b835469 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:19.634186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 121/237] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:19.639388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e926dea-e8d8-41b5-9f23-13fe5817af7d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:19.639669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e926dea-e8d8-41b5-9f23-13fe5817af7d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:19.639978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e926dea-e8d8-41b5-9f23-13fe5817af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:19.672921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8e926dea-e8d8-41b5-9f23-13fe5817af7d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:19.674215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8e926dea-e8d8-41b5-9f23-13fe5817af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:19.682736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:19.766928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 117/238] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:19.797621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063fa68-97c2-4cb9-8204-c6a24b835469 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:19.849359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:19.943542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063fa68-97c2-4cb9-8204-c6a24b835469 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:19.991422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:19.992108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:19.992390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:19.992660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.008432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:20.014577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:20.015491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:20.016760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 122/239] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:20.023900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e926dea-e8d8-41b5-9f23-13fe5817af7d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:20.062796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:20.164630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e926dea-e8d8-41b5-9f23-13fe5817af7d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:20.200468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:20.201005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.201283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.201552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.202222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:20.202523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:20.204033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:20.212428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 118/240] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:20.218530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:20.222152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:20.261533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:20.273796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324821f-343d-4b65-bd13-d22d08bc072b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:20.346672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:20.347313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.347800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.348093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.350529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:20.352891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:20.354498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 123/241] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:20.361027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:20.410943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdf82-833b-4cac-8927-2195f356c203 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:20.450771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702b9a9-2809-4e93-a9d2-e0815c4e56c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:20.452131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b9a9-2809-4e93-a9d2-e0815c4e56c0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.453046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b9a9-2809-4e93-a9d2-e0815c4e56c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.454057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b9a9-2809-4e93-a9d2-e0815c4e56c0 None admin] PATH_INFO: `/v3/users/e323e85475044cb89a6c8a97739c4577` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.476469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702b9a9-2809-4e93-a9d2-e0815c4e56c0 None admin] RBAC: Authorizing `identity:get_user(user_id=e323e85475044cb89a6c8a97739c4577)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:20.478783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702b9a9-2809-4e93-a9d2-e0815c4e56c0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:20.482075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 119/242] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:20 2022] GET /identity/v3/users/e323e85475044cb89a6c8a97739c4577 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:20.484081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87d91-dad0-4b84-a684-b822da8fba73 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.484580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87d91-dad0-4b84-a684-b822da8fba73 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.485071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87d91-dad0-4b84-a684-b822da8fba73 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.488316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 120/243] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:20.494000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a87d91-dad0-4b84-a684-b822da8fba73 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:20.504114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0513d89-b942-4ad3-af84-c1605c1d3679 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:20.542365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f473561-04ab-4058-a05e-eacec6bccb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:20.542980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473561-04ab-4058-a05e-eacec6bccb5d None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.543284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473561-04ab-4058-a05e-eacec6bccb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.543685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473561-04ab-4058-a05e-eacec6bccb5d None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.544401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473561-04ab-4058-a05e-eacec6bccb5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:20.545960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473561-04ab-4058-a05e-eacec6bccb5d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:20.570392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 124/244] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:20 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:20.571989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9191c-efbe-4d7e-a055-65489b5892ce None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.572245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9191c-efbe-4d7e-a055-65489b5892ce None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.572527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9191c-efbe-4d7e-a055-65489b5892ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.580297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:20.604171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-94c9191c-efbe-4d7e-a055-65489b5892ce None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:20.605679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-94c9191c-efbe-4d7e-a055-65489b5892ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:20.642713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:20.680067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a87d91-dad0-4b84-a684-b822da8fba73 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:20.756075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43e491-bca6-4cc3-95b4-03cffdce14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:20.756614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e491-bca6-4cc3-95b4-03cffdce14ee None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.756992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e491-bca6-4cc3-95b4-03cffdce14ee None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.757270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e491-bca6-4cc3-95b4-03cffdce14ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.761355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 125/245] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:20.847291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43e491-bca6-4cc3-95b4-03cffdce14ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:20.848907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43e491-bca6-4cc3-95b4-03cffdce14ee None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:20.923612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:20.968383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 121/246] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:20.976967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9191c-efbe-4d7e-a055-65489b5892ce None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:20.985101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110590-bd0c-47c6-9dd3-e4f37466af45 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.985380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110590-bd0c-47c6-9dd3-e4f37466af45 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.985661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110590-bd0c-47c6-9dd3-e4f37466af45 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:20.987398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 122/247] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:11:20.995199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e737330-754e-43f9-b995-03c7a9f49205 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:20.995511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e737330-754e-43f9-b995-03c7a9f49205 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:20.995753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e737330-754e-43f9-b995-03c7a9f49205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.021296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3e737330-754e-43f9-b995-03c7a9f49205 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:21.022447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3e737330-754e-43f9-b995-03c7a9f49205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:21.110504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 123/248] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:21.111209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e737330-754e-43f9-b995-03c7a9f49205 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:21.131435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9191c-efbe-4d7e-a055-65489b5892ce None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:21.179627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7d450-b125-41db-af51-a714690476b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:21.180295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d450-b125-41db-af51-a714690476b7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.181079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d450-b125-41db-af51-a714690476b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.181352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d450-b125-41db-af51-a714690476b7 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.182491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7d450-b125-41db-af51-a714690476b7 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:21.184540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7d450-b125-41db-af51-a714690476b7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:21.186558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 126/249] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:20 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:21.187971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ff7e-4666-4d28-86c5-3f9729e4530e None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.187971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ff7e-4666-4d28-86c5-3f9729e4530e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.188178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ff7e-4666-4d28-86c5-3f9729e4530e None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.189264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 127/250] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:21.194808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7de8a-b8a7-4240-80a0-b525b6e5ba1f None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.195092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7de8a-b8a7-4240-80a0-b525b6e5ba1f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.195366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7de8a-b8a7-4240-80a0-b525b6e5ba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.218104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-adc7de8a-b8a7-4240-80a0-b525b6e5ba1f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:21.219847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-adc7de8a-b8a7-4240-80a0-b525b6e5ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:21.222801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:21.234722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:21.235478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e737330-754e-43f9-b995-03c7a9f49205 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:21.285180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:21.285739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.286014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.286283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.302661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:21.307716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:21.308916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 124/251] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:21.309853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:21.316305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 128/252] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:21.317350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7de8a-b8a7-4240-80a0-b525b6e5ba1f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:21.438133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7de8a-b8a7-4240-80a0-b525b6e5ba1f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:21.478547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:21.479164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.479437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.479705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.480405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:21.480706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:21.482948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:21.492836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 129/253] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:21.493691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:21.505646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:21.557834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018bfa3-ea9a-4022-b127-d655bb793413 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:21.611899 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee343f3-c4bc-4c8c-9728-cacc6b76f791 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:21.636550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:21.637696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.637977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.638240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.638980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] RBAC: Adding query filter params (role.id=b0d3a8874c894c6c9357781283f21d6e, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=e323e85475044cb89a6c8a97739c4577) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:21.639281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:21.640775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:21.648307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 125/254] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/role_assignments?user.id=e323e85475044cb89a6c8a97739c4577&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=b0d3a8874c894c6c9357781283f21d6e => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:21.649175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:21.652702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:21.653915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.654191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.654463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.684360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:21.691410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:21.692787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:21.693593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 130/255] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:21.698288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:21.699600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:21.789548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:21.807074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff2fba-e8ae-4cff-9da5-1d67e58e43a4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:21.831668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3b97-bb51-40f3-8225-bea61d556487 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:21.873849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:21.874510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.874904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.875052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] PATH_INFO: `/v3/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.880738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] RBAC: Authorizing `identity:get_user(user_id=405b45bf0e5f4e9cbb2e29e6b35f8ce4)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:21.882241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:21.884346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 126/256] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:21.884709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:21.885182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:21.885465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:21.886022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:21.886363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:21.887873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:21.888377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:21.889889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:21.900740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 131/257] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:21.901765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:22.023924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774fd1-de0c-4d34-83ee-20c124496938 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:22.053773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:22.061659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:22.084668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:22.085236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:22.085363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae682973-dc82-41be-86ce-eb2534f25a0b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:22.085544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:22.085778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:22.086983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:22.088507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:22.090259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 132/258] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:22.092062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:22.123958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:22.124598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:22.124872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:22.125194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:22.136116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:22.142217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:22.143118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:22.143946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 127/259] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:22.144620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:22.249827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63910-9a35-4ab1-b1d8-8b2ce581dc55 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:22.284219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:22.284886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:22.285161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:22.285430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:22.287555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] RBAC: Authorizing `identity:create_grant(project_id=1b94d5a64b4f44628f8a822fa03995e6, user_id=405b45bf0e5f4e9cbb2e29e6b35f8ce4, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:22.289048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:22.309605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 128/260] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:22 2022] PUT /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:22.310597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:22.318539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:22.365284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1fc2-dab9-48ca-ad9e-acedc6de0c01 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:22.444466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:22.445092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:22.445352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:22.445617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] PATH_INFO: `/v3/users/b19527de69234d1f848b2ee6f5c5a7e7` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:22.451414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] RBAC: Authorizing `identity:get_user(user_id=b19527de69234d1f848b2ee6f5c5a7e7)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:22.455638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:22.457862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 133/261] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:22 2022] GET /identity/v3/users/b19527de69234d1f848b2ee6f5c5a7e7 => generated 283 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:22.463329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:22.530256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089f17-946e-4c49-90c5-c413010db1fe None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:22.600897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:22.618810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991681-303b-4946-b053-1b588f17e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:22.620154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991681-303b-4946-b053-1b588f17e00f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:22.620658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991681-303b-4946-b053-1b588f17e00f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:22.622263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991681-303b-4946-b053-1b588f17e00f None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:22.623212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991681-303b-4946-b053-1b588f17e00f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:22.623721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991681-303b-4946-b053-1b588f17e00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:22.632782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991681-303b-4946-b053-1b588f17e00f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:22.646634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 129/262] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:22.654407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991681-303b-4946-b053-1b588f17e00f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:22.685935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241e43-c485-4e24-8969-cead71652eea None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:22.748720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:22.749697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:22.750174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:22.750667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:22.765064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:22.824780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991681-303b-4946-b053-1b588f17e00f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:22.827100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:22.828834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:22.880656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:22.881283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:22.881499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:22.881769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] PATH_INFO: `/v3/users/b19527de69234d1f848b2ee6f5c5a7e7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:22.882952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] RBAC: Authorizing `identity:get_user(user_id=b19527de69234d1f848b2ee6f5c5a7e7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:22.884603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:22.886773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 130/263] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:22 2022] GET /identity/v3/users/b19527de69234d1f848b2ee6f5c5a7e7 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:22.891659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:22.898926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:22.937735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 134/264] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:22.944836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:23.010600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4063c7-576c-41e3-bad8-f5b716aefa08 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:23.066265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a4982-64f5-43ab-869c-d2373ccfa09a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:23.131372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:23.131963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:23.132241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:23.132511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:23.133550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:23.134174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:23.134451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:23.134722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:23.136545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:23.138204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:23.139655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:23.141458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 135/265] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:22 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:23.153731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:23.208173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:23.232843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:23.234484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:23.389858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 131/266] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:23.390020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58696d-feac-4d75-aeb7-7af1b7723978 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:23.395359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:23.448462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:23.500568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:23.501248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:23.501487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:23.501746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:23.502492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] RBAC: Adding query filter params (role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=b19527de69234d1f848b2ee6f5c5a7e7) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:23.502799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:23.504276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:23.518174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 136/267] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:23 2022] GET /identity/v3/role_assignments?user.id=b19527de69234d1f848b2ee6f5c5a7e7&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:23.572303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024449ec-efeb-4785-866f-8d7c2df02555 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:23.624174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fde21-a1e2-432a-b705-78134e24778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:23.624796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fde21-a1e2-432a-b705-78134e24778a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:23.625071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fde21-a1e2-432a-b705-78134e24778a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:23.625333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fde21-a1e2-432a-b705-78134e24778a None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:23.632788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fde21-a1e2-432a-b705-78134e24778a None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:23.634285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fde21-a1e2-432a-b705-78134e24778a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:23.636411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 132/268] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:23 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:23.642928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:23.785410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:23.790107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc37b1-7c4c-4bb4-9bc4-60d007aec6f8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:23.833368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9df58-6695-4542-88ff-0e7ed3f82f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:23.833974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9df58-6695-4542-88ff-0e7ed3f82f4d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:23.834248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9df58-6695-4542-88ff-0e7ed3f82f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:23.834512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9df58-6695-4542-88ff-0e7ed3f82f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:23.835242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9df58-6695-4542-88ff-0e7ed3f82f4d None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=b19527de69234d1f848b2ee6f5c5a7e7) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:23.835544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9df58-6695-4542-88ff-0e7ed3f82f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:23.837018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9df58-6695-4542-88ff-0e7ed3f82f4d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:23.845067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 137/269] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:23 2022] GET /identity/v3/role_assignments?user.id=b19527de69234d1f848b2ee6f5c5a7e7&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:24.144216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d5da-86a9-4e1f-a142-37f07b1c4cdf None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.144609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d5da-86a9-4e1f-a142-37f07b1c4cdf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.144801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d5da-86a9-4e1f-a142-37f07b1c4cdf None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.146365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 133/270] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:24.152615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf413-cdcf-4acb-b911-21b9085eb7a4 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.153681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf413-cdcf-4acb-b911-21b9085eb7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.153954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf413-cdcf-4acb-b911-21b9085eb7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.176967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-cadcf413-cdcf-4acb-b911-21b9085eb7a4 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:24.178593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-cadcf413-cdcf-4acb-b911-21b9085eb7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:24.217893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52d2c-c76a-4238-b272-841f3094e796 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.218222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52d2c-c76a-4238-b272-841f3094e796 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.218449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52d2c-c76a-4238-b272-841f3094e796 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.219940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 134/271] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:11:24.227117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb70fe-2418-4f2d-baf2-31c4e38cd300 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.227400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb70fe-2418-4f2d-baf2-31c4e38cd300 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.227674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb70fe-2418-4f2d-baf2-31c4e38cd300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.253788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9bbb70fe-2418-4f2d-baf2-31c4e38cd300 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:24.255209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9bbb70fe-2418-4f2d-baf2-31c4e38cd300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:24.261221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 138/272] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:24.355649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 135/273] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:24.453308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b722ba2-9757-4645-a50c-3a2fae08bf1e None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.454044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b722ba2-9757-4645-a50c-3a2fae08bf1e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.454542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b722ba2-9757-4645-a50c-3a2fae08bf1e None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.457036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 139/274] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:11:24.463645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5fd3-3e62-4736-933f-749c9e12570b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.464404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5fd3-3e62-4736-933f-749c9e12570b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.464998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5fd3-3e62-4736-933f-749c9e12570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.493082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-67df5fd3-3e62-4736-933f-749c9e12570b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:24.494673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-67df5fd3-3e62-4736-933f-749c9e12570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:24.523085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:24.549259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b722ba2-9757-4645-a50c-3a2fae08bf1e None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:24.576271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 136/275] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:24.643690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5fd3-3e62-4736-933f-749c9e12570b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:24.662872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:24.674302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b722ba2-9757-4645-a50c-3a2fae08bf1e None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:24.720406 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:24.720951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.721260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.721529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.739458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:24.744841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:24.745766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:24.747032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:24.750933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 140/276] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:11:24.751889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:24.782479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5fd3-3e62-4736-933f-749c9e12570b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:24.833593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:24.834612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.835264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.835718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.837887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:24.841134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:24.842513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 137/277] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:24.848936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:24.877762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb70462-abc3-4db3-95da-c9b84fcd9868 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:24.888627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:24.924941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:24.925518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:24.925788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:24.926271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:24.926701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:24.927007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:24.928385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:24.937719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 141/278] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:24.938336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:24.955562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:24.975180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a63b2-cb10-43ac-8bef-14523e2d719e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.012763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.013319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.013636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.013860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.014535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:25.016012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:25.040947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 138/279] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:24 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:11:25.040947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:25.051539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9a669-af15-4ec9-ba6f-f794c00e59b1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.105103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.106220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.106768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.107053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.123599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:25.131190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:25.132194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:25.132983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 142/280] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:25.139333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:25.181805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:25.208534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fd61-18bd-443f-bbb5-b040bf7597f6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.243693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:25.256694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.257348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.257628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.257902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] PATH_INFO: `/v3/users/01565dea21a941fc89d00a34df00097b` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.271319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1896ae-b0d5-4971-be20-95b753356533 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.273315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=01565dea21a941fc89d00a34df00097b)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:25.275113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:25.277485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 139/281] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:25 2022] GET /identity/v3/users/01565dea21a941fc89d00a34df00097b => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:25.286872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:25.323294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.324055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.324336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.324706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.325310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:25.325610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:25.327095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:25.336573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 143/282] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:25.342920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:25.424882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d694a-72ec-4e87-8cbc-e8c38718dbf2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.466572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf295-6af1-4563-81d3-c7e43da435a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.467189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf295-6af1-4563-81d3-c7e43da435a2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.467472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf295-6af1-4563-81d3-c7e43da435a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.467867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf295-6af1-4563-81d3-c7e43da435a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.468630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf295-6af1-4563-81d3-c7e43da435a2 None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, user.id=01565dea21a941fc89d00a34df00097b, scope.system=all) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:25.468943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf295-6af1-4563-81d3-c7e43da435a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:25.470402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf295-6af1-4563-81d3-c7e43da435a2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:25.476818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095594-abc6-4735-9a17-5da55f1fd5bb None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.477058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 140/283] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Sep 14 15:11:25 2022] GET /identity/v3/role_assignments?user.id=01565dea21a941fc89d00a34df00097b&scope.system=all&role.id=8f49b16402cd497da63ff419948304d5 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:25.523730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c577b10-9c5b-4e5b-a250-0ad4af2d6329 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.523730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c577b10-9c5b-4e5b-a250-0ad4af2d6329 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.523730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c577b10-9c5b-4e5b-a250-0ad4af2d6329 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.525431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 141/284] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:25.525883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.526709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.527154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.527424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] PATH_INFO: `/v3/users/e323e85475044cb89a6c8a97739c4577` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.529098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] RBAC: Authorizing `identity:get_user(user_id=e323e85475044cb89a6c8a97739c4577)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:25.530222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:25.532303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 144/285] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:25 2022] GET /identity/v3/users/e323e85475044cb89a6c8a97739c4577 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:25.533955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16db7e1-08b3-4071-8e21-c96001f81841 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.534469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16db7e1-08b3-4071-8e21-c96001f81841 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.534931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16db7e1-08b3-4071-8e21-c96001f81841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.538265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:25.548082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:25.563257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c16db7e1-08b3-4071-8e21-c96001f81841 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:25.564657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c16db7e1-08b3-4071-8e21-c96001f81841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:25.566904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:25.678593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 142/286] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:25.683594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a471-f765-439f-8f31-9482a070355d None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.726396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.727152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.727530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.727937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.729258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:25.730860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:25.734796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 145/287] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:25 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:25.741243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16db7e1-08b3-4071-8e21-c96001f81841 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:25.858580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16db7e1-08b3-4071-8e21-c96001f81841 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:25.905875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:25.906932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:25.907416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:25.907936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/e323e85475044cb89a6c8a97739c4577/roles/b0d3a8874c894c6c9357781283f21d6e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:25.910108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b94d5a64b4f44628f8a822fa03995e6, user_id=e323e85475044cb89a6c8a97739c4577, role_id=b0d3a8874c894c6c9357781283f21d6e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:25.911766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:25.930512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:25.937089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 143/288] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:11:25 2022] PUT /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/users/e323e85475044cb89a6c8a97739c4577/roles/b0d3a8874c894c6c9357781283f21d6e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:11:25.977361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:26.076310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:26.113011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0292f-4afc-4291-a01b-331b53894534 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:26.157233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:26.157875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:26.158146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:26.158409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:26.171795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:26.180591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:26.181567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:26.182772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 146/289] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:26.187874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:26.325245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd59f-2c8a-42cf-88a7-e2e66bbea954 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:26.373232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:26.373953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:26.374250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:26.374583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:26.375269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:26.375576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:26.377401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:26.392916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 144/290] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:26.398192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:26.537109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e82dfb-5999-4e91-a4d6-67e95c5b536f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:26.582172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:26.591095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:26.591733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:26.592037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:26.592310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] PATH_INFO: `/v3/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:26.593463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] RBAC: Authorizing `identity:get_user(user_id=405b45bf0e5f4e9cbb2e29e6b35f8ce4)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:26.594998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:26.597172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 147/291] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:26 2022] GET /identity/v3/users/405b45bf0e5f4e9cbb2e29e6b35f8ce4 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:26.602318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:26.672123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:26.729206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a80b33-2c04-44be-8aa1-6dd2e2aa491c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:26.779492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:26.780146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:26.780426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:26.780698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:26.870016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:26.872112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:26.948954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:27.000773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 145/292] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:27.005936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:27.136088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336efe7-f4da-4d46-9469-8adf137a3dfb None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:27.180533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83e5a-17ab-4c4a-a3b1-b3bb2cf2f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:27.181168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83e5a-17ab-4c4a-a3b1-b3bb2cf2f412 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:27.181447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83e5a-17ab-4c4a-a3b1-b3bb2cf2f412 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:27.181718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83e5a-17ab-4c4a-a3b1-b3bb2cf2f412 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:27.182865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83e5a-17ab-4c4a-a3b1-b3bb2cf2f412 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:27.184368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83e5a-17ab-4c4a-a3b1-b3bb2cf2f412 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:27.186387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 148/293] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:27 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:27.191860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:27.336502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c33f-27d7-4983-a8eb-a96574729813 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:27.385522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893721-5bba-430c-b158-1be6de3cbf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:27.386479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893721-5bba-430c-b158-1be6de3cbf01 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:27.387034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893721-5bba-430c-b158-1be6de3cbf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:27.388017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893721-5bba-430c-b158-1be6de3cbf01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:27.388951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893721-5bba-430c-b158-1be6de3cbf01 None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=405b45bf0e5f4e9cbb2e29e6b35f8ce4) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:27.389462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893721-5bba-430c-b158-1be6de3cbf01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:27.391110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893721-5bba-430c-b158-1be6de3cbf01 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:27.398816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 146/294] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:27 2022] GET /identity/v3/role_assignments?user.id=405b45bf0e5f4e9cbb2e29e6b35f8ce4&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=8f49b16402cd497da63ff419948304d5 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:27.952451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85cf02-d5aa-43bf-8660-3b0dddd40125 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:27.952727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85cf02-d5aa-43bf-8660-3b0dddd40125 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:27.953154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85cf02-d5aa-43bf-8660-3b0dddd40125 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:27.954879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 149/295] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:27.960522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455a48-74df-4cf1-a229-c17e36ebc8d2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:27.961378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455a48-74df-4cf1-a229-c17e36ebc8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:27.961843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455a48-74df-4cf1-a229-c17e36ebc8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:27.983386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-16455a48-74df-4cf1-a229-c17e36ebc8d2 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:27.984911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-16455a48-74df-4cf1-a229-c17e36ebc8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:28.012903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:28.075934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 147/296] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:28.148039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf563-52f6-4bf3-bba3-2e87f49597ed None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.148970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf563-52f6-4bf3-bba3-2e87f49597ed None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.149435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf563-52f6-4bf3-bba3-2e87f49597ed None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.151212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 150/297] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:28.156578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e60ebe-c686-4c71-9dd8-5bbf513755b3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.157101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e60ebe-c686-4c71-9dd8-5bbf513755b3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.157577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e60ebe-c686-4c71-9dd8-5bbf513755b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.177226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e2e60ebe-c686-4c71-9dd8-5bbf513755b3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:28.178813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e2e60ebe-c686-4c71-9dd8-5bbf513755b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:28.253334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 148/298] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:28.313222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64b1b-d584-4250-af2b-239cefba1612 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.313524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64b1b-d584-4250-af2b-239cefba1612 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.313772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64b1b-d584-4250-af2b-239cefba1612 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.315367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 151/299] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:28.320601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc2b3-1e5c-47a3-b264-1999e28a67c2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.320887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc2b3-1e5c-47a3-b264-1999e28a67c2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.321161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc2b3-1e5c-47a3-b264-1999e28a67c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.339575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-99bdc2b3-1e5c-47a3-b264-1999e28a67c2 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:28.340836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-99bdc2b3-1e5c-47a3-b264-1999e28a67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:28.361938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e64b1b-d584-4250-af2b-239cefba1612 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:28.428823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 149/300] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:28.448526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:28.491308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e64b1b-d584-4250-af2b-239cefba1612 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:28.527553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:28.528188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.528465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.528731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.530620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdc2b3-1e5c-47a3-b264-1999e28a67c2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:28.540822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:28.548844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:28.550674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:28.551549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:28.552395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:28.553001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 152/301] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:11:28.559658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:28.662323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdc2b3-1e5c-47a3-b264-1999e28a67c2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:28.682723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18b3-3623-4a6f-bdd3-69613a16ed48 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:28.699335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ef3a-f030-489b-8b1e-5a9ab53da609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:28.700274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ef3a-f030-489b-8b1e-5a9ab53da609 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.700702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ef3a-f030-489b-8b1e-5a9ab53da609 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.701284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ef3a-f030-489b-8b1e-5a9ab53da609 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.711770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:28.711950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82ef3a-f030-489b-8b1e-5a9ab53da609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-db82ef3a-f030-489b-8b1e-5a9ab53da609 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:28.719592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:28.720816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:28.721592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 150/302] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:28.722863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89a38f-91f0-4128-adad-9891e37f25f9 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.724284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89a38f-91f0-4128-adad-9891e37f25f9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.724384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89a38f-91f0-4128-adad-9891e37f25f9 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.726322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 151/303] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:28.727113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89a38f-91f0-4128-adad-9891e37f25f9 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:28.730102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:28.731365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.731645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.731943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.732632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:28.733305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:28.734726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:28.744295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 153/304] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:28.748872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:28.804420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:28.831166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89a38f-91f0-4128-adad-9891e37f25f9 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:28.850962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679f82-644e-4aca-9863-e6e3c64f9952 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:28.865404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fc5e8-09a3-405f-bc1c-5263f29db547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:28.866033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fc5e8-09a3-405f-bc1c-5263f29db547 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.866315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fc5e8-09a3-405f-bc1c-5263f29db547 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.866584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fc5e8-09a3-405f-bc1c-5263f29db547 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.867683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fc5e8-09a3-405f-bc1c-5263f29db547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:28.869149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fc5e8-09a3-405f-bc1c-5263f29db547 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:28.870722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 152/305] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:28.872081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce44e-c6d0-41b0-845e-05d85e5a8d61 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.872210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce44e-c6d0-41b0-845e-05d85e5a8d61 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.872408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce44e-c6d0-41b0-845e-05d85e5a8d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.888641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:28.889246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:28.889524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:28.889669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-333ce44e-c6d0-41b0-845e-05d85e5a8d61 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:28.889788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:28.890444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:28.890740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:28.890856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-333ce44e-c6d0-41b0-845e-05d85e5a8d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:28.892126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:28.900922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 154/306] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:28.901696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:28.955319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:28.962199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 153/307] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:28.963039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce44e-c6d0-41b0-845e-05d85e5a8d61 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.013042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9496836-b826-4f65-8f60-9c2816fcb0f1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.040589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:29.051188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.051959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.052239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.052504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] PATH_INFO: `/v3/users/8ea611f7a25647e48c96317499f543eb` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.067274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] RBAC: Authorizing `identity:get_user(user_id=8ea611f7a25647e48c96317499f543eb)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:29.068948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:29.070905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 155/308] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:28 2022] GET /identity/v3/users/8ea611f7a25647e48c96317499f543eb => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:29.071415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.076510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce44e-c6d0-41b0-845e-05d85e5a8d61 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.110684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.111308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.111648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.111955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] PATH_INFO: `/v3/groups` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.112589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:29.114020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:29.139857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 154/309] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Sep 14 15:11:28 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:29.139857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.196799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826468-dec9-43b8-a833-7cee02840504 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.211029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:29.240639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.241280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.241556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.241827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] PATH_INFO: `/v3/users/01565dea21a941fc89d00a34df00097b` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.243058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] RBAC: Authorizing `identity:get_user(user_id=01565dea21a941fc89d00a34df00097b)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:29.244581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:29.246302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 156/310] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:29 2022] GET /identity/v3/users/01565dea21a941fc89d00a34df00097b => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:29.247110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.275745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823811f1-5350-498a-b43d-8cc2e88b3fc8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.309578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:29.315961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.316645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.317196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.317908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.319036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] RBAC: Adding query filter params (role.id=b0d3a8874c894c6c9357781283f21d6e, user.id=8ea611f7a25647e48c96317499f543eb, scope.system=all) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:29.319604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:29.321565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:29.327865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 155/311] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Sep 14 15:11:29 2022] GET /identity/v3/role_assignments?user.id=8ea611f7a25647e48c96317499f543eb&scope.system=all&role.id=b0d3a8874c894c6c9357781283f21d6e => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:29.328265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.383906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85935d0a-6732-469e-aa1e-2630fa6ac932 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.441782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.442436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.442713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.442985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.457278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:29.462873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:29.463835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:29.464857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 157/312] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:29.468646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e4d03-df28-4637-8cc3-ba0b31417051 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.470281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.520742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:29.531699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.532548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.532828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.533106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] PATH_INFO: `/v3/system/users/01565dea21a941fc89d00a34df00097b/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.534576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=01565dea21a941fc89d00a34df00097b, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:29.537486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:29.547854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 156/313] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Sep 14 15:11:29 2022] PUT /identity/v3/system/users/01565dea21a941fc89d00a34df00097b/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:29.603620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c7cc-404b-490b-8b79-6235e19d03ee None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.645369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.645994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.646268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.646602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.647302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:29.647656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:29.649129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:29.659828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 158/314] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:29.665676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.743626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:29.792633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e7fa9-7334-40df-be43-343851c816d6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.828912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.829548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.829823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.830090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] PATH_INFO: `/v3/users/e323e85475044cb89a6c8a97739c4577` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:29.831260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] RBAC: Authorizing `identity:get_user(user_id=e323e85475044cb89a6c8a97739c4577)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:29.832834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:29.834684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 157/315] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:29 2022] GET /identity/v3/users/e323e85475044cb89a6c8a97739c4577 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:29.840235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:29.949838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:29.953528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bf31b-1c68-403f-95ea-94006e0a90c7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:29.994946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:29.995604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:29.995918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:29.996187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:30.068652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:30.070167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:30.193389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 159/316] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:30.193997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:30.198771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:30.309563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46902-0e25-4fd9-a229-32a93fd39973 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:30.337619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:30.347079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11864a-82fb-4d82-8e7d-9cefaa94ee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:30.347712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11864a-82fb-4d82-8e7d-9cefaa94ee04 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:30.348018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11864a-82fb-4d82-8e7d-9cefaa94ee04 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:30.348289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11864a-82fb-4d82-8e7d-9cefaa94ee04 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:30.349436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11864a-82fb-4d82-8e7d-9cefaa94ee04 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:30.350877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11864a-82fb-4d82-8e7d-9cefaa94ee04 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:30.352569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 158/317] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:30 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:30.359159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:30.474488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10565db2-ad55-4db2-8882-0b4255956e8b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:30.514477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33b98f-285c-4db5-94d6-d1f7fde602f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:30.515471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b98f-285c-4db5-94d6-d1f7fde602f2 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:30.515984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b98f-285c-4db5-94d6-d1f7fde602f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:30.516471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b98f-285c-4db5-94d6-d1f7fde602f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:30.517427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b98f-285c-4db5-94d6-d1f7fde602f2 None admin] RBAC: Adding query filter params (role.id=b0d3a8874c894c6c9357781283f21d6e, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6, user.id=e323e85475044cb89a6c8a97739c4577) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:30.517953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b98f-285c-4db5-94d6-d1f7fde602f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:30.519577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b98f-285c-4db5-94d6-d1f7fde602f2 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:30.527142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 160/318] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:11:30 2022] GET /identity/v3/role_assignments?user.id=e323e85475044cb89a6c8a97739c4577&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=b0d3a8874c894c6c9357781283f21d6e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:31.487979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac2d6-1556-40ab-941b-3f1d15b08195 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:31.488537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac2d6-1556-40ab-941b-3f1d15b08195 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:31.488537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac2d6-1556-40ab-941b-3f1d15b08195 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:31.489933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 159/319] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:31.495658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fb4b5-e8ee-4058-9890-de8e5293391a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:31.496810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fb4b5-e8ee-4058-9890-de8e5293391a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:31.496810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fb4b5-e8ee-4058-9890-de8e5293391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:31.515981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-490fb4b5-e8ee-4058-9890-de8e5293391a None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:31.517230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-490fb4b5-e8ee-4058-9890-de8e5293391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:31.588436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:31.603190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 161/320] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:31.625120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adf926-1123-4c42-9a31-bf9d854c217d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:31.625410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adf926-1123-4c42-9a31-bf9d854c217d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:31.625666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adf926-1123-4c42-9a31-bf9d854c217d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:31.627159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 160/321] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:31.632386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd75319-b403-4ad6-b60b-90a9f9f5bf2e None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:31.632666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd75319-b403-4ad6-b60b-90a9f9f5bf2e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:31.632937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd75319-b403-4ad6-b60b-90a9f9f5bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:31.651164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-5fd75319-b403-4ad6-b60b-90a9f9f5bf2e None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:31.652365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5fd75319-b403-4ad6-b60b-90a9f9f5bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:31.726103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 162/322] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:31.815448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195615-eaa3-45ee-93a1-b81f287a875a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:31.815748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195615-eaa3-45ee-93a1-b81f287a875a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:31.815946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195615-eaa3-45ee-93a1-b81f287a875a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:31.817430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 161/323] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:31.822401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb92f-1a6d-4606-ada5-77b83abe7fa5 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:31.822700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb92f-1a6d-4606-ada5-77b83abe7fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:31.822972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb92f-1a6d-4606-ada5-77b83abe7fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:31.841251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9aedb92f-1a6d-4606-ada5-77b83abe7fa5 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:31.842421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9aedb92f-1a6d-4606-ada5-77b83abe7fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:31.876003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05195615-eaa3-45ee-93a1-b81f287a875a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:31.916030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 163/324] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:31.982974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05195615-eaa3-45ee-93a1-b81f287a875a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:31.997673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedb92f-1a6d-4606-ada5-77b83abe7fa5 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.018251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.018889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.019162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.019421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.020613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.022307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.028204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 162/325] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:32.030318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.061819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:32.099796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:32.110566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedb92f-1a6d-4606-ada5-77b83abe7fa5 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.141869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44fc4e-3000-453b-9b49-6c01f017d208 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.146868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.147492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.147761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.148067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.161684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:32.166628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:32.167685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:32.168626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:32.169519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 164/326] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:11:32.174558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.182927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.183539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.183874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.184155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] PATH_INFO: `/v3/groups` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.184793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.186228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.202497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 163/327] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Sep 14 15:11:32 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:11:32.203356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.289040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4301e-b06c-4f3f-9a5f-b2c4f78346cc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.307948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:32.334516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94a3bc-7659-4397-a81e-5796785740c9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.337184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.337731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.338003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.338267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.338959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:32.339250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.341536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.351403 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 165/328] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:32.356888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.364401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:32.380458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.381444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.382173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.382173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.394326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:32.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:32.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:32.402591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 164/329] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:32.407291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.486130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdb9bc-ddd1-431b-ab93-3e4510f7e3bc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.530418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.531041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.531365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.531637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] PATH_INFO: `/v3/users/8ea611f7a25647e48c96317499f543eb` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.535767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] RBAC: Authorizing `identity:get_user(user_id=8ea611f7a25647e48c96317499f543eb)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.537617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.538169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34feb-51be-4894-bd23-c5e5c44994bf None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.539302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 166/330] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:32 2022] GET /identity/v3/users/8ea611f7a25647e48c96317499f543eb => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:32.545297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.589166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.590045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.590398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.590745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.591756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:32.592105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.594376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.609196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 165/331] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:32.611303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:32.617662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.670963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:32.683458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef5c8-121b-4a7c-b9a3-1fab7f93e561 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.735854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.736627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.736887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.737156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] PATH_INFO: `/v3/system/users/8ea611f7a25647e48c96317499f543eb/roles/b0d3a8874c894c6c9357781283f21d6e` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.738595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8ea611f7a25647e48c96317499f543eb, role_id=b0d3a8874c894c6c9357781283f21d6e)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.739999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.744302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35171233-3857-49cc-9156-12bdd7e35b74 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.751858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 167/332] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Sep 14 15:11:32 2022] PUT /identity/v3/system/users/8ea611f7a25647e48c96317499f543eb/roles/b0d3a8874c894c6c9357781283f21d6e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:32.789435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3af9dc-70d4-4615-8909-5ddf5d3962ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.790402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3af9dc-70d4-4615-8909-5ddf5d3962ec None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.790831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3af9dc-70d4-4615-8909-5ddf5d3962ec None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.791327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3af9dc-70d4-4615-8909-5ddf5d3962ec None admin] PATH_INFO: `/v3/users/01565dea21a941fc89d00a34df00097b` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.792937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3af9dc-70d4-4615-8909-5ddf5d3962ec None admin] RBAC: Authorizing `identity:get_user(user_id=01565dea21a941fc89d00a34df00097b)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.795125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3af9dc-70d4-4615-8909-5ddf5d3962ec None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.797554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 166/333] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:32 2022] GET /identity/v3/users/01565dea21a941fc89d00a34df00097b => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:32.803510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:32.922937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e34a-c149-4def-9338-dbf8111c5c01 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:32.933521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:32.963775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f7e82-e19b-453e-b74a-0526f83d7b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:32.964433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7e82-e19b-453e-b74a-0526f83d7b9a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:32.964712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7e82-e19b-453e-b74a-0526f83d7b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:32.965552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7e82-e19b-453e-b74a-0526f83d7b9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:32.966315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7e82-e19b-453e-b74a-0526f83d7b9a None admin] RBAC: Adding query filter params (role.id=8f49b16402cd497da63ff419948304d5, user.id=01565dea21a941fc89d00a34df00097b, scope.system=all) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:32.966624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7e82-e19b-453e-b74a-0526f83d7b9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:32.968314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7e82-e19b-453e-b74a-0526f83d7b9a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:32.981495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 168/334] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Sep 14 15:11:32 2022] GET /identity/v3/role_assignments?user.id=01565dea21a941fc89d00a34df00097b&scope.system=all&role.id=8f49b16402cd497da63ff419948304d5 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:34.960357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e9a3-e77e-41aa-9ba5-d4d69b2db1a8 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:34.961393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e9a3-e77e-41aa-9ba5-d4d69b2db1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:34.961876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e9a3-e77e-41aa-9ba5-d4d69b2db1a8 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:34.963724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 167/335] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:34.982706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2d91-9c05-4997-bbf3-430acd3c8091 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:34.983646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2d91-9c05-4997-bbf3-430acd3c8091 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:34.984144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2d91-9c05-4997-bbf3-430acd3c8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:34.990509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb15b4-f54c-46a4-bbf9-bff525281ffd None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:34.991107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb15b4-f54c-46a4-bbf9-bff525281ffd None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:34.991610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb15b4-f54c-46a4-bbf9-bff525281ffd None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:34.993214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 168/336] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:35.004747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cc59-f44e-4803-a890-7dc84b1d9f5d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:35.005075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cc59-f44e-4803-a890-7dc84b1d9f5d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:35.005285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cc59-f44e-4803-a890-7dc84b1d9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:35.012549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-d71c2d91-9c05-4997-bbf3-430acd3c8091 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:35.014089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-d71c2d91-9c05-4997-bbf3-430acd3c8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:35.032837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-59e8cc59-f44e-4803-a890-7dc84b1d9f5d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:35.034047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-59e8cc59-f44e-4803-a890-7dc84b1d9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:35.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 169/337] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:35.175491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 169/338] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:35.637324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c2d91-9c05-4997-bbf3-430acd3c8091 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:35.643000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc772b-de2a-4962-9224-f0c54f20689a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:35.643619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc772b-de2a-4962-9224-f0c54f20689a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:35.644133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc772b-de2a-4962-9224-f0c54f20689a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:35.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 170/339] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:35.652608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37bed4-775c-4f55-80ad-5ebe2c3a362b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:35.653248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37bed4-775c-4f55-80ad-5ebe2c3a362b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:35.653726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37bed4-775c-4f55-80ad-5ebe2c3a362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:35.684844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2e37bed4-775c-4f55-80ad-5ebe2c3a362b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:35.686524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2e37bed4-775c-4f55-80ad-5ebe2c3a362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:35.770004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:35.772559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:35.784162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c2d91-9c05-4997-bbf3-430acd3c8091 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:35.829762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4583ebc-f80a-4053-8f08-5be836e709bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:35.831398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 171/340] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:35.832335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37bed4-775c-4f55-80ad-5ebe2c3a362b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:35.832624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4583ebc-f80a-4053-8f08-5be836e709bd None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:35.833067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4583ebc-f80a-4053-8f08-5be836e709bd None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:35.833477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4583ebc-f80a-4053-8f08-5be836e709bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:35.845508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4583ebc-f80a-4053-8f08-5be836e709bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-f4583ebc-f80a-4053-8f08-5be836e709bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:35.851006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:35.852145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:35.853136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:35.857138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 170/341] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:35.859740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd4a9-468e-4065-a905-8c0a280d6226 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:35.860414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd4a9-468e-4065-a905-8c0a280d6226 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:35.860861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd4a9-468e-4065-a905-8c0a280d6226 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:35.863121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 171/342] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:35.868397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd4a9-468e-4065-a905-8c0a280d6226 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:36.035568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37bed4-775c-4f55-80ad-5ebe2c3a362b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:36.051880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd4a9-468e-4065-a905-8c0a280d6226 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:36.084482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678ec84-1ab3-49fd-bd11-6570e841a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:36.085684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678ec84-1ab3-49fd-bd11-6570e841a462 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:36.086140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678ec84-1ab3-49fd-bd11-6570e841a462 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:36.086676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678ec84-1ab3-49fd-bd11-6570e841a462 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:36.099700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678ec84-1ab3-49fd-bd11-6570e841a462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f678ec84-1ab3-49fd-bd11-6570e841a462 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:36.106151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:36.107096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:36.107993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:36.110898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 172/343] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:36.112919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92773951-abdc-4b3e-bdf8-32236d6d3932 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:36.113539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92773951-abdc-4b3e-bdf8-32236d6d3932 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:36.114044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92773951-abdc-4b3e-bdf8-32236d6d3932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:36.139934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-92773951-abdc-4b3e-bdf8-32236d6d3932 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:36.141550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-92773951-abdc-4b3e-bdf8-32236d6d3932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:36.149122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:36.149827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:36.150426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:36.150768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:36.151524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:36.151914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:36.154254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:36.168791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 172/344] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:36.169920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:36.180832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:36.197571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:36.239376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 173/345] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:36.247836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92773951-abdc-4b3e-bdf8-32236d6d3932 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:36.313239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a2225-0cba-4782-9971-71d2e3337ba0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:36.353228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:36.353847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:36.354121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:36.354391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:36.355263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] RBAC: Adding query filter params (name=member) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:36.356625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:36.358450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:36.379079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 173/346] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:36.379771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:36.472344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92773951-abdc-4b3e-bdf8-32236d6d3932 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:36.519676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:36.553103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:36.553759 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:36.554033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:36.554301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:36.556722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318d75-58ec-4b6d-b545-791d5e7af50a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:36.582812 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:36.591278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:36.592265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:36.593110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 174/347] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:36.593774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:36.620784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:36.621898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:36.622251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:36.622584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:36.641907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:36.710315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:36.711990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:36.739922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46398-d136-4950-a526-09c3c5b6941c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:36.786717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:36.787344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:36.787639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:36.788048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:36.818869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:36.849747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 174/348] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:36.850735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:36.904785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:36.906161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:36.943603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:36.995252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf035e-0291-44e7-af40-5d439bf03564 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.047282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.048402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.048826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.049214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.062731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 175/349] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:37.063698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.064206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:37.070730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:37.071661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 175/350] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:37.073273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.132083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:37.220169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c496e-0540-443f-abf4-87c049eca509 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.227494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8502a-86d1-4b60-8a8c-701e335e9e28 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.258421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:37.266998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.268418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.268714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.269273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.270670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:37.272681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:37.273125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.273751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.274033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.274297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.274811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 176/351] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:37.275228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:37.275523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:37.276101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.277029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:37.290456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 176/352] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:37.291139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.408330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b713593-5dc8-4599-a06f-bb6d55d5ef99 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.411762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b061c4-72c2-41d0-a1e1-cc799070831a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.419792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:37.453657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.454305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.454580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.454857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.455060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.455527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:37.455710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.455834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:37.455997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.456232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.457214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:37.457323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:37.458741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:37.460490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 177/353] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:37.461272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.467176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 177/354] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:37.468165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.532778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:37.583794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92e0ba-0418-4878-aec7-cc0dbeff8295 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.599186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f898985-a886-457d-b88b-27be4f53c219 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.635375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312acd5f-d1b7-4387-b8a2-fa47c4d20f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.636527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312acd5f-d1b7-4387-b8a2-fa47c4d20f02 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.637049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312acd5f-d1b7-4387-b8a2-fa47c4d20f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.637518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312acd5f-d1b7-4387-b8a2-fa47c4d20f02 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.646747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312acd5f-d1b7-4387-b8a2-fa47c4d20f02 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:37.648736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312acd5f-d1b7-4387-b8a2-fa47c4d20f02 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:37.650673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 178/355] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:37.653607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f5ff-bf20-4e95-9368-ea21c5a57788 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.653889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f5ff-bf20-4e95-9368-ea21c5a57788 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.654161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f5ff-bf20-4e95-9368-ea21c5a57788 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.655852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 179/356] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:37.656818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513da2-bbfb-42af-b876-b521971f9afa None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.657103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513da2-bbfb-42af-b876-b521971f9afa None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.657378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513da2-bbfb-42af-b876-b521971f9afa None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.658702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 180/357] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:37.663256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56513da2-bbfb-42af-b876-b521971f9afa None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.663560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.664220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.664499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.664774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.717575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:37.744723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:37.745773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:37.796678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56513da2-bbfb-42af-b876-b521971f9afa None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.801553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:37.838656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:37.840259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:37.840732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:37.841173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:37.842472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:37.843983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:37.845554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 181/358] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:37.846324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.866338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 178/359] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:37.867286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:37.969967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1d405-62cf-48f3-a5cd-2b5d8c22ccc1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:37.980067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:37.988558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448bc2-c2aa-4f2b-adf1-aea3a0eb2fb8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:38.014769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b68cb7-dcdb-4736-8ee1-786be8bd6e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.015397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68cb7-dcdb-4736-8ee1-786be8bd6e09 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.015672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68cb7-dcdb-4736-8ee1-786be8bd6e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.015970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68cb7-dcdb-4736-8ee1-786be8bd6e09 None admin] PATH_INFO: `/v3/users/8ea611f7a25647e48c96317499f543eb` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.017111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b68cb7-dcdb-4736-8ee1-786be8bd6e09 None admin] RBAC: Authorizing `identity:get_user(user_id=8ea611f7a25647e48c96317499f543eb)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:38.018531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b68cb7-dcdb-4736-8ee1-786be8bd6e09 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:38.020302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 182/360] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/users/8ea611f7a25647e48c96317499f543eb => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:38.021263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9e25-b5c2-42b5-9f36-3d08733f38e9 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.021538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9e25-b5c2-42b5-9f36-3d08733f38e9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.021804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9e25-b5c2-42b5-9f36-3d08733f38e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.030654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10631130-ba51-434e-9784-8798f53e75f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.031268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631130-ba51-434e-9784-8798f53e75f6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.031546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631130-ba51-434e-9784-8798f53e75f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.031898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631130-ba51-434e-9784-8798f53e75f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.032580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631130-ba51-434e-9784-8798f53e75f6 None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=377d1de7a4264c508b034627d8435703) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:38.032883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631130-ba51-434e-9784-8798f53e75f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:38.034315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631130-ba51-434e-9784-8798f53e75f6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:38.040750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 179/361] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:37 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:38.043000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-243b9e25-b5c2-42b5-9f36-3d08733f38e9 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:38.043121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc9680-1a6c-4448-9842-d8ec0cfd5386 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.043121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc9680-1a6c-4448-9842-d8ec0cfd5386 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.043121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc9680-1a6c-4448-9842-d8ec0cfd5386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.044776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-243b9e25-b5c2-42b5-9f36-3d08733f38e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:38.065342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f6cc9680-1a6c-4448-9842-d8ec0cfd5386 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:38.066483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f6cc9680-1a6c-4448-9842-d8ec0cfd5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:38.083067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:38.144096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 183/362] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:38.144836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9e25-b5c2-42b5-9f36-3d08733f38e9 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:38.175916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 180/363] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:38.176792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc9680-1a6c-4448-9842-d8ec0cfd5386 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:38.299678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc9680-1a6c-4448-9842-d8ec0cfd5386 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:38.316041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9e25-b5c2-42b5-9f36-3d08733f38e9 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:38.330780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:38.351837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.351837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.351837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.351837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.352358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:38.352358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:38.354042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 181/364] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:38.355036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:38.370568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:38.394763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.395651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.396165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.396578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.397510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=377d1de7a4264c508b034627d8435703) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:38.397958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:38.401569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:38.413381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 184/365] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=8f49b16402cd497da63ff419948304d5 => generated 260 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:38.415131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:38.546711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c610b-e9b4-428f-a7d3-64a9fe44bb12 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:38.585719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.586265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.586546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.586821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.587569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] RBAC: Adding query filter params (role.id=b0d3a8874c894c6c9357781283f21d6e, user.id=8ea611f7a25647e48c96317499f543eb, scope.system=all) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:38.587917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:38.588867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dad2ab-f393-478b-a8fc-66a7a4bdf472 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:38.589387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:38.603900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 182/366] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/role_assignments?user.id=8ea611f7a25647e48c96317499f543eb&scope.system=all&role.id=b0d3a8874c894c6c9357781283f21d6e => generated 510 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:38.608848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:38.640443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.641506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.642023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.642569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.644128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:38.647997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:38.650493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 185/367] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:38.651594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:38.715397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:38.732457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:38.789676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dced0-ed75-4974-a17b-455d6f516711 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:38.791690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447d144-0fe7-4b7f-a3a2-fd4a05cb4bb6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:38.833185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.834225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.834863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.835442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.848933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:38.856550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:38.857491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:38.858282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:38.858894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:38.858894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:38.858894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:38.858894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:38.861142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 186/368] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:38.862204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:38.880482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:38.886141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:38.887093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:38.887904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:38.888520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 183/369] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:38.889166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:39.018442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:39.023897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a588-59b6-47ab-9492-9a6f8dd3892f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.048090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5529ac-e541-46a6-8bf2-b0485655925c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.082492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:39.084374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:39.085189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:39.085784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:39.087744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:39.089657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:39.090920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:39.093707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:39.099154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:39.099708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:39.100017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:39.100291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:39.100974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:39.101270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:39.102184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 187/370] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=8f49b16402cd497da63ff419948304d5 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:39.102990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:39.103722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:39.123566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 184/371] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:39.130240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:39.245387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede03c2-acaa-4b92-bf48-1beb9a8b9973 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.329637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:39.330144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:39.330422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:39.330691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:39.331431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:39.331654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:39.333097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:39.337549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc172ea-7e20-4302-99ee-3b8ec8e64a52 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.346783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 188/372] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:39.352439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:39.378697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:39.379670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:39.380155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:39.380619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:39.406754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:39.473913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:39.486128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:39.488632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:39.507847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfe8c-5313-4838-ab2b-efd56d166e7e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.549565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:39.550183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:39.550475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:39.550729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:39.606083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 185/373] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:11:39.614810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:39.635305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:39.638029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:39.671291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:39.746442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:39.763583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79452e-4e37-4e37-b4ef-036420080e52 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.764509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 189/374] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:11:39.770339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:39.816773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:39.817422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:39.817700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:39.817975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] PATH_INFO: `/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:39.819429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] RBAC: Authorizing `identity:get_project(project_id=52aec70ff9234a3bb3cc3d70110b0f57)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:39.821017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:39.823125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 186/375] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:39 2022] GET /identity/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:39.829773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:39.877626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe55f-340e-44b0-bc9f-b86ffd2190d2 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.943606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:39.974431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:39.975073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:39.975349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:39.975620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:39.978209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b67f1c-3838-4a9d-b63e-a9b02d3fa277 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:39.980467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:39.981904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:39.983731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 190/376] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:39 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:39.992484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:40.040617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:40.041650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:40.042126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:40.042601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] PATH_INFO: `/v3/groups/fa2b7a40b75e4960b0629f9007f0a020` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:40.064496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] RBAC: Authorizing `identity:get_group(group_id=fa2b7a40b75e4960b0629f9007f0a020)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:40.066349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:40.068608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 187/377] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:39 2022] GET /identity/v3/groups/fa2b7a40b75e4960b0629f9007f0a020 => generated 229 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:40.074810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:40.117702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:40.126772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d3e2-446c-435d-ad21-1e68507732cb None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:40.164823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:40.165483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:40.165757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:40.166028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:40.170940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:40.170940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:40.170940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 191/378] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:39 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:40.177203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:40.245516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:40.254059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de111711-5f36-4346-81bb-ddda2822223c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:40.289364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba065e-b121-4592-a63e-5baad3a449d6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:40.327714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36659a-064d-4981-9012-292e8054cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:40.328525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36659a-064d-4981-9012-292e8054cb43 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:40.328804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36659a-064d-4981-9012-292e8054cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:40.329075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36659a-064d-4981-9012-292e8054cb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:40.329816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36659a-064d-4981-9012-292e8054cb43 None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:40.330117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36659a-064d-4981-9012-292e8054cb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:40.331564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36659a-064d-4981-9012-292e8054cb43 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:40.338832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 192/379] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:40 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:40.352769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808d2ac-1f2e-4100-bd05-b56266574764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:40.353822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808d2ac-1f2e-4100-bd05-b56266574764 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:40.354383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808d2ac-1f2e-4100-bd05-b56266574764 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:40.354857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808d2ac-1f2e-4100-bd05-b56266574764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:40.356437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808d2ac-1f2e-4100-bd05-b56266574764 None admin] RBAC: Adding query filter params (group.id=fa2b7a40b75e4960b0629f9007f0a020, role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=52aec70ff9234a3bb3cc3d70110b0f57) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:40.356975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808d2ac-1f2e-4100-bd05-b56266574764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:40.358657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808d2ac-1f2e-4100-bd05-b56266574764 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:40.365309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 188/380] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:40 2022] GET /identity/v3/role_assignments?group.id=fa2b7a40b75e4960b0629f9007f0a020&scope.project.id=52aec70ff9234a3bb3cc3d70110b0f57&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:41.209091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c8c1-1a8e-4a2d-85ff-15fc7291bfd9 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:41.209483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c8c1-1a8e-4a2d-85ff-15fc7291bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:41.209676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c8c1-1a8e-4a2d-85ff-15fc7291bfd9 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:41.211268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 193/381] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:41.217425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99590f6-1b1f-4fdb-9874-05142a880a1d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:41.217886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99590f6-1b1f-4fdb-9874-05142a880a1d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:41.217978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99590f6-1b1f-4fdb-9874-05142a880a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:41.221847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7532e-0492-4bb0-90f7-5c87240248d6 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:41.222241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7532e-0492-4bb0-90f7-5c87240248d6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:41.222516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7532e-0492-4bb0-90f7-5c87240248d6 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:41.224210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 194/382] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:41.229309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ea8f7-dea8-4ddf-8a96-a6eb2432880d None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:41.229589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ea8f7-dea8-4ddf-8a96-a6eb2432880d None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:41.229862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ea8f7-dea8-4ddf-8a96-a6eb2432880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:41.243097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b99590f6-1b1f-4fdb-9874-05142a880a1d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:41.245201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b99590f6-1b1f-4fdb-9874-05142a880a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:41.265266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-6e7ea8f7-dea8-4ddf-8a96-a6eb2432880d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:41.266482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-6e7ea8f7-dea8-4ddf-8a96-a6eb2432880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:41.380049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 189/383] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:41.398529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 195/384] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:41.711903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99590f6-1b1f-4fdb-9874-05142a880a1d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:41.731300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:41.759799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ea8f7-dea8-4ddf-8a96-a6eb2432880d None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:41.866091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99590f6-1b1f-4fdb-9874-05142a880a1d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:41.868842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:41.926304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:41.926953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:41.927234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:41.927507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:41.940996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:41.946762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:41.948883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:41.950778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 190/385] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:41.954517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:41.970017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ea8f7-dea8-4ddf-8a96-a6eb2432880d None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.043443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.044101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.044375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.044644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.067185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:42.072128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:42.074200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:42.075845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 196/386] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:42.082418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:42.086245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:42.119767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce390a-11df-4a1e-92cf-c93ca44c0648 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.181410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.182020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.182296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.182619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.183293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:42.183632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.185065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.201973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 191/387] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:42.204733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:42.269039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c5c08-4aec-412f-abd8-605ca5b53715 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.297116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:42.335009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.335619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.335912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.336348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.337255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:42.337712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.339311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.349198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 197/388] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:42.356868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:42.389519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb53aa-2bcc-4dc7-af25-8c033d96c72f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.456673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.457595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.458033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.458443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.461571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.463206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.469936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 192/389] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:42 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:42.475251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:42.490429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:42.502838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e639-1a44-4197-9674-548ef5138b17 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.541810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec2ab-5b96-423d-b985-1d7389f1c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.542874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec2ab-5b96-423d-b985-1d7389f1c940 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.543330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec2ab-5b96-423d-b985-1d7389f1c940 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.543906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec2ab-5b96-423d-b985-1d7389f1c940 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.545199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec2ab-5b96-423d-b985-1d7389f1c940 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.547078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec2ab-5b96-423d-b985-1d7389f1c940 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.549205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 198/390] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:42 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:42.550611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e491-73fb-4312-aa26-3a046530d2bd None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.551135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e491-73fb-4312-aa26-3a046530d2bd None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.551585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e491-73fb-4312-aa26-3a046530d2bd None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.553225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 199/391] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:42.555324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7e491-73fb-4312-aa26-3a046530d2bd None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:42.609955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eb0a3-5728-4fcd-9aa1-76d2d167afbe None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.620718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:42.649882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047225-5703-44e4-b6ea-7ef3767a9f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.650798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047225-5703-44e4-b6ea-7ef3767a9f46 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.651136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047225-5703-44e4-b6ea-7ef3767a9f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.651473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047225-5703-44e4-b6ea-7ef3767a9f46 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.653332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047225-5703-44e4-b6ea-7ef3767a9f46 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.654852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047225-5703-44e4-b6ea-7ef3767a9f46 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.657039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 193/392] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:42 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:42.658269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab95e-58ea-4035-9b9b-c99511a4a8aa None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.658652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab95e-58ea-4035-9b9b-c99511a4a8aa None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.659070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab95e-58ea-4035-9b9b-c99511a4a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.678707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6a4ab95e-58ea-4035-9b9b-c99511a4a8aa None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:42.680097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6a4ab95e-58ea-4035-9b9b-c99511a4a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:42.685424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7e491-73fb-4312-aa26-3a046530d2bd None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.725565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.726227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.726568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.726843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.728105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.729592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.731895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 200/393] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:42 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:42.732786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:42.764159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 194/394] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:42.765100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab95e-58ea-4035-9b9b-c99511a4a8aa None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:42.768487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:42.841110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab28ef5-5d2e-4296-9e41-ac0bd7d4f731 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.854422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:42.876700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab95e-58ea-4035-9b9b-c99511a4a8aa None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:42.878314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78379-f408-4c3f-80ce-0adeca28944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.879017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78379-f408-4c3f-80ce-0adeca28944f None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.879300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78379-f408-4c3f-80ce-0adeca28944f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.879572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78379-f408-4c3f-80ce-0adeca28944f None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703/groups/0195e72ff6674a069625b63b4e32d041/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.881571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea78379-f408-4c3f-80ce-0adeca28944f None admin] RBAC: Authorizing `identity:create_grant(project_id=377d1de7a4264c508b034627d8435703, group_id=0195e72ff6674a069625b63b4e32d041, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.883070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea78379-f408-4c3f-80ce-0adeca28944f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.902666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 201/395] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Sep 14 15:11:42 2022] PUT /identity/v3/projects/377d1de7a4264c508b034627d8435703/groups/0195e72ff6674a069625b63b4e32d041/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:42.904131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764144e8-c895-46e6-8c36-ab44c2ce5427 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.904420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764144e8-c895-46e6-8c36-ab44c2ce5427 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.904757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764144e8-c895-46e6-8c36-ab44c2ce5427 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.906577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 202/396] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:42.912527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e5d6-c53b-4fbf-aa0b-e50e584196e3 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.912853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e5d6-c53b-4fbf-aa0b-e50e584196e3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.913069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e5d6-c53b-4fbf-aa0b-e50e584196e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.918050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1751826-e144-4db7-a914-0322e7ef6190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:42.918800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1751826-e144-4db7-a914-0322e7ef6190 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:42.919078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1751826-e144-4db7-a914-0322e7ef6190 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:42.919343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1751826-e144-4db7-a914-0322e7ef6190 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703/groups/0195e72ff6674a069625b63b4e32d041/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:42.921811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1751826-e144-4db7-a914-0322e7ef6190 None admin] RBAC: Authorizing `identity:create_grant(project_id=377d1de7a4264c508b034627d8435703, group_id=0195e72ff6674a069625b63b4e32d041, role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:42.923353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1751826-e144-4db7-a914-0322e7ef6190 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:42.935116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4918e5d6-c53b-4fbf-aa0b-e50e584196e3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:42.936473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4918e5d6-c53b-4fbf-aa0b-e50e584196e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:42.941806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 195/397] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Sep 14 15:11:42 2022] PUT /identity/v3/projects/377d1de7a4264c508b034627d8435703/groups/0195e72ff6674a069625b63b4e32d041/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:43.048985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 203/398] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:43.208358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7f73-df68-45d6-8d21-49acb711c6d1 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:43.208358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7f73-df68-45d6-8d21-49acb711c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:43.208358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7f73-df68-45d6-8d21-49acb711c6d1 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:43.209271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 196/399] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:43.214926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de8979-5515-4fa9-a3a7-c142ef59d2b3 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:43.215196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de8979-5515-4fa9-a3a7-c142ef59d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:43.215466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de8979-5515-4fa9-a3a7-c142ef59d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:43.218985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea7f73-df68-45d6-8d21-49acb711c6d1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:43.237195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-e8de8979-5515-4fa9-a3a7-c142ef59d2b3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:43.238718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-e8de8979-5515-4fa9-a3a7-c142ef59d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:43.320890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:43.374550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 204/400] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:43.375510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de8979-5515-4fa9-a3a7-c142ef59d2b3 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:43.396487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea7f73-df68-45d6-8d21-49acb711c6d1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:43.434188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:43.465783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:43.466339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:43.466609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:43.466882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:43.483565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:43.488517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:43.489388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:43.490170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:43.491842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 197/401] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:43.498186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:43.561793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de8979-5515-4fa9-a3a7-c142ef59d2b3 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:43.640578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:43.641457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:43.641739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:43.642006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:43.646975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452b4b-3c6e-44a7-8a62-7aa6b557b5ca None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:43.665085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:43.670320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:43.671183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:43.672001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:43.674509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 205/402] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:43.680446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:43.698484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:43.710186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:43.710795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:43.711065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:43.711329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:43.712063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:43.712328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:43.713685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:43.722338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 198/403] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:43.723432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:43.785772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:43.797882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f64c-2694-4364-9c2d-9202824f9bac None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:43.834595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eba1a-eb56-4c1a-9821-d1769156d1b5 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:43.837772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:43.838382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:43.838652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:43.838914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:43.839610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:43.839934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:43.841293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:43.850877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 206/404] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:43.851854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:43.876647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:43.877342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:43.877622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:43.877898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:43.890241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:43.896599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:43.897518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:43.898322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:43.903090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 199/405] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:43.904206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:43.965996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:43.971180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43823a-697d-4f2b-bc44-212178147836 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.015730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.016880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.017687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.018101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.019383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.021714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.023995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 207/406] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:43 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:44.025204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.039443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b614a8-eacf-4ac5-aa04-434f43cba7e0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.059759 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:44.078602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.079422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.079795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.080241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] PATH_INFO: `/v3/groups/fa2b7a40b75e4960b0629f9007f0a020` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.081693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] RBAC: Authorizing `identity:get_group(group_id=fa2b7a40b75e4960b0629f9007f0a020)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.083520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.085582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 200/407] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:43 2022] GET /identity/v3/groups/fa2b7a40b75e4960b0629f9007f0a020 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:44.086626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.154266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e306ce-e21a-4d24-82a3-878fc9909d66 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.196160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.196917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.197291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.197660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.198586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:44.199499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.201259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.212063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 208/408] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:44.213165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.218399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252b64-62fe-45d8-86d6-108b4162285c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.238167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:44.266591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.267948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.268613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.269029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.270734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.273155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.275912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 201/409] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:44 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:44.276834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.317391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:44.338802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d7fcc-6356-4f2d-b57c-86b7ec4e5c4b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.385909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.387955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.388582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.389004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] PATH_INFO: `/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.390467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] RBAC: Authorizing `identity:get_project(project_id=52aec70ff9234a3bb3cc3d70110b0f57)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.392107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.394711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 209/410] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:44 2022] GET /identity/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:44.395623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.410406 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd896-0b09-4440-9b77-da95b113a06a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.445880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.446700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.447074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.447457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.449770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.451332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.453676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 202/411] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:44 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:44.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.511039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:44.526617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48263566-674a-4511-b017-6d3724a8e13c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.565832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.566724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.567176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.567606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/groups/0195e72ff6674a069625b63b4e32d041/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.567771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c34e04-40f0-4ee9-b26e-7eaf59f41b79 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.569842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b94d5a64b4f44628f8a822fa03995e6, group_id=0195e72ff6674a069625b63b4e32d041, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.571474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.595857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 210/412] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Sep 14 15:11:44 2022] PUT /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/groups/0195e72ff6674a069625b63b4e32d041/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:44.595857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.638374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:44.641138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.642013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.642496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.642958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] PATH_INFO: `/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57/groups/fa2b7a40b75e4960b0629f9007f0a020/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.646504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] RBAC: Authorizing `identity:create_grant(project_id=52aec70ff9234a3bb3cc3d70110b0f57, group_id=fa2b7a40b75e4960b0629f9007f0a020, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.648539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.667563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 203/413] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Sep 14 15:11:44 2022] PUT /identity/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57/groups/fa2b7a40b75e4960b0629f9007f0a020/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:44.806578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685fc7b-a655-4e1a-a7f6-dffc2d884864 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.849411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0f03a-dfb0-49d3-9a36-b51c11682e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:44.850342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0f03a-dfb0-49d3-9a36-b51c11682e57 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:44.850900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0f03a-dfb0-49d3-9a36-b51c11682e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:44.851395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0f03a-dfb0-49d3-9a36-b51c11682e57 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:44.852827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0f03a-dfb0-49d3-9a36-b51c11682e57 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:44.854582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0f03a-dfb0-49d3-9a36-b51c11682e57 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:44.857829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 211/414] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:44 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:44.863996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:44.986065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e660cb6-770a-47b9-bef6-8b38a4e09216 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:44.998601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:45.026572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffb44-439f-4441-88a3-b00b05e71437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:45.027292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffb44-439f-4441-88a3-b00b05e71437 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:45.027572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffb44-439f-4441-88a3-b00b05e71437 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:45.027862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffb44-439f-4441-88a3-b00b05e71437 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/groups/0195e72ff6674a069625b63b4e32d041/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:45.030125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffb44-439f-4441-88a3-b00b05e71437 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b94d5a64b4f44628f8a822fa03995e6, group_id=0195e72ff6674a069625b63b4e32d041, role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:45.031598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffb44-439f-4441-88a3-b00b05e71437 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:45.047088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 204/415] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Sep 14 15:11:44 2022] PUT /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6/groups/0195e72ff6674a069625b63b4e32d041/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:11:45.333601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a97be-55ba-4046-895a-f8d827051bb2 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:45.334002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a97be-55ba-4046-895a-f8d827051bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:45.334201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a97be-55ba-4046-895a-f8d827051bb2 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:45.335694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 212/416] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:45.345423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb113b-9059-4499-9164-ac4ed0839f16 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:45.345722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb113b-9059-4499-9164-ac4ed0839f16 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:45.345988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb113b-9059-4499-9164-ac4ed0839f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:45.376602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c3cb113b-9059-4499-9164-ac4ed0839f16 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:45.377803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c3cb113b-9059-4499-9164-ac4ed0839f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:45.432522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb03368-44cf-4288-a7e7-434635ea2ee7 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:45.433031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb03368-44cf-4288-a7e7-434635ea2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:45.433031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb03368-44cf-4288-a7e7-434635ea2ee7 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:45.435110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 213/417] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:11:45.440736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4e4e-6e90-417f-a0cf-8e28fd12620f None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:45.441011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4e4e-6e90-417f-a0cf-8e28fd12620f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:45.441282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4e4e-6e90-417f-a0cf-8e28fd12620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:45.463609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-b31d4e4e-6e90-417f-a0cf-8e28fd12620f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:45.465031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b31d4e4e-6e90-417f-a0cf-8e28fd12620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:45.466790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 205/418] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:45.534865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 214/419] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:45.867106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb113b-9059-4499-9164-ac4ed0839f16 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:45.961548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4e4e-6e90-417f-a0cf-8e28fd12620f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:45.976310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:45.982146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:45.982950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb113b-9059-4499-9164-ac4ed0839f16 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:46.046524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:46.047217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:46.047492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:46.047758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:46.072991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:46.078112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:46.079309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:46.080133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:46.086992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 206/420] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:46.087971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:46.154221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4e4e-6e90-417f-a0cf-8e28fd12620f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:46.217243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:46.217874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:46.218147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:46.218415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:46.241017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:46.246335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:46.247223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:46.248183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 215/421] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:46.254780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:46.265450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b334-3cb5-4f11-9dea-c923217efd42 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:46.345220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:46.346102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:46.346550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:46.346955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:46.347759 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:46.348213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:46.349735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:46.368469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 207/422] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:46.369006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:46.373284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:46.418073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e043db-974d-4005-bc1e-9980fb1cfdee None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:46.420398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:46.458605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:46.459980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:46.460470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:46.460942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:46.461788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:46.462301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:46.464038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:46.478031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 216/423] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:46.479641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:46.535849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf1d6-c3ad-44c7-b78d-772e9660c7d1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:46.565855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:46.566471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:46.566747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:46.567017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:46.640475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:46.641922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:46.652050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e6c1-8374-4131-b140-3b7f45b8cafa None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:46.684129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:46.688769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:46.694590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:46.695371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:46.695724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:46.696119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:46.773311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:46.775236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:46.877623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 208/424] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:46.879456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 217/425] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:11:46.883193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:46.885963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:46.936246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:47.061909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249a4af-aab2-4f40-8ff5-8b27e610d3ee None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:47.065183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108882c-010e-42dd-8804-29c63d877f07 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:47.108325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:47.129677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:47.130310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.130615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.130857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.132493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:47.133944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:47.135781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 209/426] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:46 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:47.136245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:47.136902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.137171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.137434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] PATH_INFO: `/v3/projects/377d1de7a4264c508b034627d8435703` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.142831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] RBAC: Authorizing `identity:get_project(project_id=377d1de7a4264c508b034627d8435703)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:47.144296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:47.146048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 218/427] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:46 2022] GET /identity/v3/projects/377d1de7a4264c508b034627d8435703 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:47.146794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:47.152355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:47.310753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde84e-e3dc-4adf-9977-95a4e3c2dbe5 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:47.348803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:47.349542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:47.351265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.351902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.352375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.353967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:47.355004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399a8f0-f535-4d01-856e-ec136f55d1ae None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:47.357674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:47.360112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 210/428] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:47 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:47.369769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:47.399213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d20b35-48b3-48ea-bd21-86cf4655e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:47.400438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20b35-48b3-48ea-bd21-86cf4655e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.400882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20b35-48b3-48ea-bd21-86cf4655e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.401411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20b35-48b3-48ea-bd21-86cf4655e6f4 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.403243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d20b35-48b3-48ea-bd21-86cf4655e6f4 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:47.404987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d20b35-48b3-48ea-bd21-86cf4655e6f4 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:47.407103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 219/429] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:47 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:47.408991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5cc2b-f887-442c-8b01-783ab8b320f9 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.409633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5cc2b-f887-442c-8b01-783ab8b320f9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.410297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5cc2b-f887-442c-8b01-783ab8b320f9 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.413356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 220/430] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:47.414358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5cc2b-f887-442c-8b01-783ab8b320f9 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:47.460551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:47.519003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686ccf-8946-4135-a390-e01ed0f84b45 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:47.531225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5cc2b-f887-442c-8b01-783ab8b320f9 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:47.557133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ac6bf-1887-4427-8599-d62a0055af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:47.557860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ac6bf-1887-4427-8599-d62a0055af73 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.558159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ac6bf-1887-4427-8599-d62a0055af73 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.558408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ac6bf-1887-4427-8599-d62a0055af73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.559245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ac6bf-1887-4427-8599-d62a0055af73 None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=377d1de7a4264c508b034627d8435703) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:47.559555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ac6bf-1887-4427-8599-d62a0055af73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:47.561188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ac6bf-1887-4427-8599-d62a0055af73 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:47.566214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd823af5-5091-409f-aa42-093ce14a871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:47.566808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823af5-5091-409f-aa42-093ce14a871b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.567079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823af5-5091-409f-aa42-093ce14a871b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.567490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 211/431] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:47 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=8f49b16402cd497da63ff419948304d5 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:47.568057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823af5-5091-409f-aa42-093ce14a871b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.568711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90999d6b-4116-4268-b0f9-c6fa92af0254 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.568986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90999d6b-4116-4268-b0f9-c6fa92af0254 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.569259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90999d6b-4116-4268-b0f9-c6fa92af0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.569736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd823af5-5091-409f-aa42-093ce14a871b None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=377d1de7a4264c508b034627d8435703) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:47.570291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd823af5-5091-409f-aa42-093ce14a871b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:47.572161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd823af5-5091-409f-aa42-093ce14a871b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:47.588535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 221/432] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:47 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=377d1de7a4264c508b034627d8435703&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:47.588535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c097-8f04-4423-aa21-d43bb5dce2f5 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.588535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c097-8f04-4423-aa21-d43bb5dce2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.588535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c097-8f04-4423-aa21-d43bb5dce2f5 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.588535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 222/433] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:47.601092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb576-7f19-469b-9b4d-f4da48fd163f None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.601464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb576-7f19-469b-9b4d-f4da48fd163f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.601649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb576-7f19-469b-9b4d-f4da48fd163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.606181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-90999d6b-4116-4268-b0f9-c6fa92af0254 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:47.607607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-90999d6b-4116-4268-b0f9-c6fa92af0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:47.646208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-be3fb576-7f19-469b-9b4d-f4da48fd163f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:47.648555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-be3fb576-7f19-469b-9b4d-f4da48fd163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:47.712075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:47.757275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 212/434] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:47.784664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 223/435] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:47.806952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aaf9e-cb06-4f4c-a091-cb45a2a99687 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.807264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aaf9e-cb06-4f4c-a091-cb45a2a99687 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.807512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aaf9e-cb06-4f4c-a091-cb45a2a99687 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.809228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 213/436] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:47.815513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bae29e-cd85-4601-854a-333c2d2cf24f None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:47.816124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bae29e-cd85-4601-854a-333c2d2cf24f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:47.816596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bae29e-cd85-4601-854a-333c2d2cf24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:47.837393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-44bae29e-cd85-4601-854a-333c2d2cf24f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:47.838931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-44bae29e-cd85-4601-854a-333c2d2cf24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:47.917359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 224/437] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:48.046453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aaf9e-cb06-4f4c-a091-cb45a2a99687 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.082411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bae29e-cd85-4601-854a-333c2d2cf24f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.104010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.156581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aaf9e-cb06-4f4c-a091-cb45a2a99687 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.191284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.198674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.199976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.200530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.200810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.204532 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bae29e-cd85-4601-854a-333c2d2cf24f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.212944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:48.219627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:48.220648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:48.221606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 214/438] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:48.222473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.248414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.248992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.249269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.249583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.266230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:48.271119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:48.272120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:48.272950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 225/439] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:48.274390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.345535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6b1b1-6b81-47f1-928d-e4d745658b7c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.358137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.380592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.381224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.381505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.381777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.382993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88b059-bf50-4a69-acd7-e2c4627a5db6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.392289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:48.397542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:48.398462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:48.399259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 215/440] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:48.399947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.420553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.421157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.421428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.421699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.422354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:48.422654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:48.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:48.432277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 226/441] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:48.432880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.448277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.510709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e8c8a-252c-4318-a302-dd81a93db465 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.531623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe6eb-22f1-4675-a2a5-f951299f34c4 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.544060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.544661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.544942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.545212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.545879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:48.546177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:48.547562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:48.555545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 216/442] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:48.556380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.565623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.566229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.566501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.566768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.567423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:48.567724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:48.569118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:48.577419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 227/443] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:48.578259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.598837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.673162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.673445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adf1c-c8b9-4f64-8edc-220df8b771f2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.700306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0fe67-8de4-468d-8eea-455bb4b2d898 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:48.711936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.712556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.712839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.713111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.736084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:48.736689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:48.736964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:48.737228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:48.780559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:48.782051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:48.806827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:48.808912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:48.817393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.885392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 217/444] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:48.886309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.886868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:48.915339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 228/445] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:48.916551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:48.990157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da413c3-1920-469c-b7b9-086a3e5152a2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.016545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d50cc-73ef-44fb-9cc1-a2e01f90ae21 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.024428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.025283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.025560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.025831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.028939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:49.051150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.051771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.052087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.052356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] PATH_INFO: `/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.053468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] RBAC: Authorizing `identity:get_project(project_id=52aec70ff9234a3bb3cc3d70110b0f57)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.054883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.056544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 229/446] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/projects/52aec70ff9234a3bb3cc3d70110b0f57 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.057303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.098465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.099982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.111520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:49.169228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd58c-3840-4e53-9403-647f7973b73a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.199529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 218/447] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:49.200425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.206554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.207173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.207445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.207710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.208860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.210289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.216650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 230/448] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.216650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.236028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:49.301519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcd6fc-98a7-4778-afe9-e1a52489acbd None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.312325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81763b22-4126-4dcd-913f-7a7a8961eae3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.326359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:49.335875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.336513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.336790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.337062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] PATH_INFO: `/v3/groups/fa2b7a40b75e4960b0629f9007f0a020` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.338173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] RBAC: Authorizing `identity:get_group(group_id=fa2b7a40b75e4960b0629f9007f0a020)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.340170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.341756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 219/449] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/groups/fa2b7a40b75e4960b0629f9007f0a020 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.342524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.349865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.350494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.350765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.351034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] PATH_INFO: `/v3/projects/1b94d5a64b4f44628f8a822fa03995e6` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.352165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] RBAC: Authorizing `identity:get_project(project_id=1b94d5a64b4f44628f8a822fa03995e6)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.353582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.355215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 231/450] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/projects/1b94d5a64b4f44628f8a822fa03995e6 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.355986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.453430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c9a9-988e-40e4-8b36-10deb9daac87 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.455192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:49.456334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096781b-e21c-49c0-974a-4814834493eb None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.490748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.491258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.491375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.491642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.491874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.491967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.492150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.492424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.493043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.493146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] RBAC: Adding query filter params (group.id=fa2b7a40b75e4960b0629f9007f0a020, role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=52aec70ff9234a3bb3cc3d70110b0f57) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:49.493483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.494496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.494882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.496159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 220/451] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.496919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.505705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 232/452] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/role_assignments?group.id=fa2b7a40b75e4960b0629f9007f0a020&scope.project.id=52aec70ff9234a3bb3cc3d70110b0f57&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.506376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.567015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:49.630834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78a9ab-4487-4703-8de1-f47d12cccb38 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.640854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af70f98-7ea4-45b5-ac7e-cd7af2fcc440 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.669887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.670552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.670831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.671103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] PATH_INFO: `/v3/groups/0195e72ff6674a069625b63b4e32d041` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.672302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] RBAC: Authorizing `identity:get_group(group_id=0195e72ff6674a069625b63b4e32d041)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.673775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.675429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 221/453] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/groups/0195e72ff6674a069625b63b4e32d041 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.681295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:49.681821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c27061-df39-4937-a126-dd51ab4e14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.682438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27061-df39-4937-a126-dd51ab4e14ac None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.682714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27061-df39-4937-a126-dd51ab4e14ac None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.682983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27061-df39-4937-a126-dd51ab4e14ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.684281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c27061-df39-4937-a126-dd51ab4e14ac None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=8f49b16402cd497da63ff419948304d5, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:49.684587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c27061-df39-4937-a126-dd51ab4e14ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.687453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c27061-df39-4937-a126-dd51ab4e14ac None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.695776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 233/454] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=8f49b16402cd497da63ff419948304d5 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:49.736807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:49.804087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7053a1f-fba4-401c-b84d-a8e627476f09 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:49.840800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e608da0-217d-4bc9-b9b6-a85fd76c8e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:49.841413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608da0-217d-4bc9-b9b6-a85fd76c8e5c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:49.841691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608da0-217d-4bc9-b9b6-a85fd76c8e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:49.841963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608da0-217d-4bc9-b9b6-a85fd76c8e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:49.842719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e608da0-217d-4bc9-b9b6-a85fd76c8e5c None admin] RBAC: Adding query filter params (group.id=0195e72ff6674a069625b63b4e32d041, role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=1b94d5a64b4f44628f8a822fa03995e6) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:49.843027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e608da0-217d-4bc9-b9b6-a85fd76c8e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:49.844542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e608da0-217d-4bc9-b9b6-a85fd76c8e5c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:49.851045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 222/455] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Sep 14 15:11:49 2022] GET /identity/v3/role_assignments?group.id=0195e72ff6674a069625b63b4e32d041&scope.project.id=1b94d5a64b4f44628f8a822fa03995e6&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:52.551997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075e6a-3db4-4b40-a434-555e840f2948 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:52.552513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075e6a-3db4-4b40-a434-555e840f2948 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:52.552586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075e6a-3db4-4b40-a434-555e840f2948 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:52.553900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 234/456] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:52.569718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d977-918f-41f9-91a4-45e6ff5af3bc None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:52.570226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d977-918f-41f9-91a4-45e6ff5af3bc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:52.570302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d977-918f-41f9-91a4-45e6ff5af3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:52.593569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3654d977-918f-41f9-91a4-45e6ff5af3bc None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:52.594783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3654d977-918f-41f9-91a4-45e6ff5af3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:52.675254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 223/457] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:52.992101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50101-5298-4c0c-b0f8-188cea654f13 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:52.992787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50101-5298-4c0c-b0f8-188cea654f13 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:52.993270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50101-5298-4c0c-b0f8-188cea654f13 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:52.995093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 235/458] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:53.001352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d016f-a31f-475f-96e2-5c100e67405c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.001947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d016f-a31f-475f-96e2-5c100e67405c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.002433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d016f-a31f-475f-96e2-5c100e67405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.028832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a48d016f-a31f-475f-96e2-5c100e67405c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:53.030379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a48d016f-a31f-475f-96e2-5c100e67405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:53.059121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df50101-5298-4c0c-b0f8-188cea654f13 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:53.075095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:53.170462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 224/459] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:53.213674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df50101-5298-4c0c-b0f8-188cea654f13 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:53.223670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:53.250868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595b9a6-3092-4eb4-8f16-a436ce4ce17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:53.251414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b9a6-3092-4eb4-8f16-a436ce4ce17d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.251692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b9a6-3092-4eb4-8f16-a436ce4ce17d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.251997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b9a6-3092-4eb4-8f16-a436ce4ce17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.263044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595b9a6-3092-4eb4-8f16-a436ce4ce17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:53.264522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595b9a6-3092-4eb4-8f16-a436ce4ce17d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3595b9a6-3092-4eb4-8f16-a436ce4ce17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:53.280419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:53.281454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:53.282322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:53.282322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:53.282322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:53.282322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 236/460] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:53.287928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d016f-a31f-475f-96e2-5c100e67405c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:53.303105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddad85-3604-465f-86f8-fb34787b335e None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.304905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddad85-3604-465f-86f8-fb34787b335e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.306122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddad85-3604-465f-86f8-fb34787b335e None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.307734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 237/461] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:53.313250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6c9c-355c-4f07-85e4-77a8d44ab3dc None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.314559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6c9c-355c-4f07-85e4-77a8d44ab3dc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.315055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6c9c-355c-4f07-85e4-77a8d44ab3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.347044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-985f6c9c-355c-4f07-85e4-77a8d44ab3dc None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:53.349186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-985f6c9c-355c-4f07-85e4-77a8d44ab3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:53.465293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 238/462] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:11:53.489697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d016f-a31f-475f-96e2-5c100e67405c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:53.504842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17d41-8bc9-4edd-8375-4ae89598c3ed None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.505330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17d41-8bc9-4edd-8375-4ae89598c3ed None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.505732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17d41-8bc9-4edd-8375-4ae89598c3ed None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.507557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 239/463] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:11:53.508499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b17d41-8bc9-4edd-8375-4ae89598c3ed None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:53.542116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83daf-9bed-4041-9530-9d67eb99c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:53.543860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83daf-9bed-4041-9530-9d67eb99c061 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.544345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83daf-9bed-4041-9530-9d67eb99c061 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.544870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83daf-9bed-4041-9530-9d67eb99c061 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.545727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83daf-9bed-4041-9530-9d67eb99c061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:53.546255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83daf-9bed-4041-9530-9d67eb99c061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:53.548127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83daf-9bed-4041-9530-9d67eb99c061 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:53.561237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 225/464] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:53.562909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1bd7-a7be-43bb-854c-9dad5ce14bc7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.563497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1bd7-a7be-43bb-854c-9dad5ce14bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.564095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1bd7-a7be-43bb-854c-9dad5ce14bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.583758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5c1e1bd7-a7be-43bb-854c-9dad5ce14bc7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:53.585733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5c1e1bd7-a7be-43bb-854c-9dad5ce14bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:53.612427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:53.625074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:53.639780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b17d41-8bc9-4edd-8375-4ae89598c3ed None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:53.672876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 226/465] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:53.678539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1bd7-a7be-43bb-854c-9dad5ce14bc7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:53.682235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:53.683087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.683536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.684243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.697167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:53.699341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:53.719226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:53.720225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:53.721079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:53.721079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:53.721079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:53.723439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 240/466] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:53.729553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:53.818508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1bd7-a7be-43bb-854c-9dad5ce14bc7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:53.857860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:53.858723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.859175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.859288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174f83-8319-4406-be04-e170f00895b8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:53.859703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.860534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:53.862276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:53.888505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 227/467] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:53 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:53.889922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:53.907061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:53.911242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:53.912002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:53.912254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:53.912525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:53.913202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:53.913502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:53.915299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:53.941277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 241/468] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:53.947180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:53.951780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:54.028295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d825ab-985a-41e8-8340-6f855d80c92b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.069434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:54.070483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.070965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.071420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.087326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:54.089885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:54.101659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7ef15-c831-4c0c-b08b-5ebbbc05786b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:54.107476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:54.108612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:54.109698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:54.109698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:54.109698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:54.111724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 228/469] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:54.112882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:54.144951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:54.145561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.145835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.146351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.146757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:54.148229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:54.172301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 242/470] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:53 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:54.173163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:54.197218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:54.261258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169a531-90bb-491e-a659-066485bc2a77 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.274209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:54.316732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41345b-469c-438a-8347-2e0b294d7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:54.317502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41345b-469c-438a-8347-2e0b294d7d57 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.318198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41345b-469c-438a-8347-2e0b294d7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.318539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41345b-469c-438a-8347-2e0b294d7d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.332927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a7603-e30f-46f3-a7fb-58f4484c80af None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.337009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41345b-469c-438a-8347-2e0b294d7d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:54.338611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41345b-469c-438a-8347-2e0b294d7d57 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-7d41345b-469c-438a-8347-2e0b294d7d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:54.358996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:54.360010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:54.360882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:54.360882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:54.360882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:54.360882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 229/471] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:54.361661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a9aa-598b-498e-aad3-66a63600db7d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.361938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a9aa-598b-498e-aad3-66a63600db7d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.362208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a9aa-598b-498e-aad3-66a63600db7d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.367348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 230/472] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:54.369734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a9aa-598b-498e-aad3-66a63600db7d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:54.383278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83308c-ac82-48a9-ac87-8555d1f66b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:54.383948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83308c-ac82-48a9-ac87-8555d1f66b80 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.384229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83308c-ac82-48a9-ac87-8555d1f66b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.384494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83308c-ac82-48a9-ac87-8555d1f66b80 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.385136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83308c-ac82-48a9-ac87-8555d1f66b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:54.385431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83308c-ac82-48a9-ac87-8555d1f66b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:54.387366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83308c-ac82-48a9-ac87-8555d1f66b80 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:54.400663 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 243/473] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:54.401751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac117-2173-478a-a923-8459c094e8ff None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.402031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac117-2173-478a-a923-8459c094e8ff None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.402419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac117-2173-478a-a923-8459c094e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.421516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-e40ac117-2173-478a-a923-8459c094e8ff None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:54.422743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-e40ac117-2173-478a-a923-8459c094e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:54.495230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a9aa-598b-498e-aad3-66a63600db7d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.512345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 244/474] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:54.513244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ac117-2173-478a-a923-8459c094e8ff None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:54.514363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:54.559503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:54.560158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.560432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.564402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.564402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:54.564402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:54.564402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:54.585952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 231/475] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:54.592183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:54.601494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:54.654280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ac117-2173-478a-a923-8459c094e8ff None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.691427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:54.692366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.692743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.693121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.693882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:54.695413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:54.724064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 245/476] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:54 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:11:54.818571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:54.824972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3bf9-8080-4e45-8fa2-16cc53ef8157 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.874852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:54.876060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:54.876348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:54.876620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:54.877509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:54.879001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:54.911019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 232/477] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:11:54 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:11:54.993618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3fc6f-fdd0-44ea-a36d-cef77e12ad22 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:54.996694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:55.035217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:55.035937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:55.036212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:55.036544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:55.037234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:55.038636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:55.047678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.sql.core [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 15:11:55.047678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 15:11:55.047678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [parameters: {'id': '7ee1223205644a93bc9be520b0ebc225', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 15:11:55.047678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result.read() Sep 14 15:11:55.066127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return ref.to_dict() Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:11:55.067054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application yield resource Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise self.value Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application session.commit() Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 15:11:55.067986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.session.flush() Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application compat.raise_( Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 15:11:55.068844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:11:55.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result.read() Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:11:55.070512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [parameters: {'id': '7ee1223205644a93bc9be520b0ebc225', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:55.071274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 15:11:55.072105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:55.073042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 246/478] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Sep 14 15:11:54 2022] POST /identity/v3/roles => generated 144 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:55.079404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:55.122444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:55.225735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47942410-9f2b-48de-b41e-e9bf3fb8798b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:55.260743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7a559-d7db-4597-9db6-05be70cb8c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:55.261906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a559-d7db-4597-9db6-05be70cb8c23 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:55.262179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a559-d7db-4597-9db6-05be70cb8c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:55.262447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a559-d7db-4597-9db6-05be70cb8c23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:55.273592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7a559-d7db-4597-9db6-05be70cb8c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-84e7a559-d7db-4597-9db6-05be70cb8c23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:55.279706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:55.281868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:55.283777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 233/479] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:11:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:55.291838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:55.395789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59a257-28ff-49f0-ac7a-c2d899749080 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:55.432146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98a123-c809-4999-801f-115394746b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:55.432812 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98a123-c809-4999-801f-115394746b18 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:55.433135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98a123-c809-4999-801f-115394746b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:55.433397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98a123-c809-4999-801f-115394746b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:55.434069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98a123-c809-4999-801f-115394746b18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:55.434361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98a123-c809-4999-801f-115394746b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:55.435723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98a123-c809-4999-801f-115394746b18 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:55.444216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 247/480] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:56.533990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4573c-dcd9-4177-a0ef-61ae5772d426 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:56.534513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4573c-dcd9-4177-a0ef-61ae5772d426 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:56.534513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4573c-dcd9-4177-a0ef-61ae5772d426 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:56.536232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 234/481] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:56.542914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e1923-e4f2-48d5-a0cd-16b0fb8b3b94 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:56.543447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e1923-e4f2-48d5-a0cd-16b0fb8b3b94 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:56.543522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e1923-e4f2-48d5-a0cd-16b0fb8b3b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:56.567512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-596e1923-e4f2-48d5-a0cd-16b0fb8b3b94 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:56.568761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-596e1923-e4f2-48d5-a0cd-16b0fb8b3b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:56.595339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:56.640403 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 248/482] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:56.717819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48fd3d-c20e-43e5-a017-b6531a4072d2 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:56.718162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48fd3d-c20e-43e5-a017-b6531a4072d2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:56.718434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48fd3d-c20e-43e5-a017-b6531a4072d2 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:56.720104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 235/483] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:56.725348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737980c-fcba-496e-ad36-9bf7092be554 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:56.725633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737980c-fcba-496e-ad36-9bf7092be554 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:56.725903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737980c-fcba-496e-ad36-9bf7092be554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:56.752844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9737980c-fcba-496e-ad36-9bf7092be554 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:56.754039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9737980c-fcba-496e-ad36-9bf7092be554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:56.832345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 249/484] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:57.002331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48fd3d-c20e-43e5-a017-b6531a4072d2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.113161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:57.131435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48fd3d-c20e-43e5-a017-b6531a4072d2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:57.161797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737980c-fcba-496e-ad36-9bf7092be554 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.178849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:57.179479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.179752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.180046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.200790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:57.205573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:57.206473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:57.207265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 236/485] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:57.212556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.303634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:57.323033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737980c-fcba-496e-ad36-9bf7092be554 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:57.335567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db861cc-76b9-4ad7-bb68-6849c5709714 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:57.391670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:57.392243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.392517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.392785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.399153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:57.399770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.400319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.400597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.401270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:57.401568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:57.402973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:57.418270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:57.423140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:57.424050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:57.424843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:57.430418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 237/486] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:57.430552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 250/487] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:11:57.433429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.434314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.446996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:57.567328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36a674-b9c8-4e91-a2c3-8e039f697597 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:57.594064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3071-c656-4f6a-ba6b-ee35c77c0d41 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:57.607836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:57.607836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.607836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.607836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.614886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:57.618236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:57.632511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:57.633450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:57.634357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:57.634357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:57.634357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:57.634357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 251/488] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:57.639448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.642305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:57.677945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:57.678565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.678845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.679118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.679796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:57.680118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:57.681504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:57.703295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 238/489] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:57.708775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.774131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e85bd-a2f8-40c3-8de4-15fa8ed92887 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:57.806563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:57.844677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785deee-4844-4b53-84b7-78bf6142175b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:57.851000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:57.851604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.851900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.852171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.852811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:57.853103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:57.854466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:57.867950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 252/490] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:57.873393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.899411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9d8e-e965-4971-9653-f304266e716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:57.900033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9d8e-e965-4971-9653-f304266e716c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9d8e-e965-4971-9653-f304266e716c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.900836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9d8e-e965-4971-9653-f304266e716c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.926338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9d8e-e965-4971-9653-f304266e716c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:57.929655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9d8e-e965-4971-9653-f304266e716c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-49ab9d8e-e965-4971-9653-f304266e716c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:57.949255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:57.951366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:57.953419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:57.953419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:57.953419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:57.953419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 239/491] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:11:57.953419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd5324-1d4f-48b7-9897-e2b3b2baee34 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:57.953419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd5324-1d4f-48b7-9897-e2b3b2baee34 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:57.953419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd5324-1d4f-48b7-9897-e2b3b2baee34 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:57.954153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 240/492] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:57.956968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd5324-1d4f-48b7-9897-e2b3b2baee34 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:57.987288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:58.037564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4e39-7a52-4d42-bdf6-18dc2904e14f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.070761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd5324-1d4f-48b7-9897-e2b3b2baee34 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.073063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c125a4-e095-4d81-a4ff-93ef571846c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.074696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c125a4-e095-4d81-a4ff-93ef571846c9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.074971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c125a4-e095-4d81-a4ff-93ef571846c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.075238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c125a4-e095-4d81-a4ff-93ef571846c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.083825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c125a4-e095-4d81-a4ff-93ef571846c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:58.085344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c125a4-e095-4d81-a4ff-93ef571846c9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:58.097173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-22c125a4-e095-4d81-a4ff-93ef571846c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:11:58.099016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:58.099966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 253/493] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba101f-861d-475a-bdfd-05f81717e839 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.106340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba101f-861d-475a-bdfd-05f81717e839 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.107015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba101f-861d-475a-bdfd-05f81717e839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.117924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b49b70-23a4-4aa9-a985-7a62cd6397fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.118581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b49b70-23a4-4aa9-a985-7a62cd6397fb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.118949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b49b70-23a4-4aa9-a985-7a62cd6397fb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.119228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b49b70-23a4-4aa9-a985-7a62cd6397fb None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.119908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b49b70-23a4-4aa9-a985-7a62cd6397fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:58.120238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b49b70-23a4-4aa9-a985-7a62cd6397fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:58.121055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-faba101f-861d-475a-bdfd-05f81717e839 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:58.121617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b49b70-23a4-4aa9-a985-7a62cd6397fb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:58.122252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-faba101f-861d-475a-bdfd-05f81717e839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:58.137335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 241/494] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:11:58.138611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50b80-2f32-47c5-ab72-64648ba14bdf None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.138901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50b80-2f32-47c5-ab72-64648ba14bdf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.139175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50b80-2f32-47c5-ab72-64648ba14bdf None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.144582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 242/495] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:58.145423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b50b80-2f32-47c5-ab72-64648ba14bdf None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:58.207657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 254/496] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:58.209081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba101f-861d-475a-bdfd-05f81717e839 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:58.265183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b50b80-2f32-47c5-ab72-64648ba14bdf None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.285853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:58.313156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee74573-6ae0-4748-bb89-e00870a50bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.314043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74573-6ae0-4748-bb89-e00870a50bff None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.314467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74573-6ae0-4748-bb89-e00870a50bff None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.315413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74573-6ae0-4748-bb89-e00870a50bff None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.316391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee74573-6ae0-4748-bb89-e00870a50bff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:58.316870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee74573-6ae0-4748-bb89-e00870a50bff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:58.319391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee74573-6ae0-4748-bb89-e00870a50bff None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:58.342632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba101f-861d-475a-bdfd-05f81717e839 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.366325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 243/497] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:58.368662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3876ece-9d71-4415-9e74-f39902e62f78 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.369381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3876ece-9d71-4415-9e74-f39902e62f78 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.370287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3876ece-9d71-4415-9e74-f39902e62f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.377987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0038-f6c1-45ea-91d8-376e88631067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.378602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0038-f6c1-45ea-91d8-376e88631067 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.378878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0038-f6c1-45ea-91d8-376e88631067 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.379148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0038-f6c1-45ea-91d8-376e88631067 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.387395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0038-f6c1-45ea-91d8-376e88631067 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:58.388879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0038-f6c1-45ea-91d8-376e88631067 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:58.393425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c3876ece-9d71-4415-9e74-f39902e62f78 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:58.394848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c3876ece-9d71-4415-9e74-f39902e62f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-403c0038-f6c1-45ea-91d8-376e88631067 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:11:58.400863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:58.402314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:58.403213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 255/498] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:11:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:58.404380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9860699-7651-4c14-9aa2-3a990c9c3bbc None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.404380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9860699-7651-4c14-9aa2-3a990c9c3bbc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.404380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9860699-7651-4c14-9aa2-3a990c9c3bbc None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.405459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 256/499] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:11:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:11:58.406150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9860699-7651-4c14-9aa2-3a990c9c3bbc None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:58.443796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:58.486548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 244/500] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:58.486548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3876ece-9d71-4415-9e74-f39902e62f78 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:58.531349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9860699-7651-4c14-9aa2-3a990c9c3bbc None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.544885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:58.567765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.568512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.568665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.568931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.591298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3876ece-9d71-4415-9e74-f39902e62f78 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.633413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59acbae-cb43-400c-adae-c86f0a59ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.634113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acbae-cb43-400c-adae-c86f0a59ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.634512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acbae-cb43-400c-adae-c86f0a59ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.634847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acbae-cb43-400c-adae-c86f0a59ecd8 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.635644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59acbae-cb43-400c-adae-c86f0a59ecd8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:58.636647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59acbae-cb43-400c-adae-c86f0a59ecd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:58.638159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59acbae-cb43-400c-adae-c86f0a59ecd8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:58.651566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:58.653627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:58.660848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 245/501] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Sep 14 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:58.660848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfcf38-347f-4275-b15c-54b91ddebf06 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.660848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfcf38-347f-4275-b15c-54b91ddebf06 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.660848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfcf38-347f-4275-b15c-54b91ddebf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.676437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b6dfcf38-347f-4275-b15c-54b91ddebf06 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:11:58.677654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b6dfcf38-347f-4275-b15c-54b91ddebf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:11:58.705742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:58.752724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 246/502] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:11:58.753875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfcf38-347f-4275-b15c-54b91ddebf06 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:58.768279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 257/503] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:58.769297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:58.788998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:58.860512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfcf38-347f-4275-b15c-54b91ddebf06 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.888520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a161d-fff7-482a-9afa-e17d5bcbfdf1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:58.897418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.898066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.898460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.898736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.910660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:58.915668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:58.916556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:58.917390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 247/504] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:58.918050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:58.930434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:58.931330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:58.931777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:58.932261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:58.943486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.008799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.010166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.025437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.033472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c8d5-7d52-4d8e-acb9-8bb0fc556d40 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.067769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.068420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.068698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.068964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.081388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:11:59.086708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:59.087628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 248/505] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:59.088628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.115715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 258/506] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:11:59.116691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.172039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.193174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f42480-6c0e-4344-adec-3fad4fb7ebef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.215974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68db6-a0d9-4c81-9d3c-488655306085 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.226414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.227034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.227306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.227571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.229089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.238301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.239699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.252239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.252828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.253098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.253362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.254007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:59.254298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:59.255013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:59.255967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:59.256838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:59.256838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.256838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:59.257000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.257076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 249/507] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:59.257076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.264620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 259/508] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:59.265671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.358274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4121-14ec-435f-a3e1-1509f60e297a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.365793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a4f45-fbfd-4f56-be3c-cdcf33a914db None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.386356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.392087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.392717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.392995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.393264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.397890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.398479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.398751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.399016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.399666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:59.400015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.402125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.404528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.405991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.410285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 260/509] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:59.411081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:59.420746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:59.421895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:59.423320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:59.423320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.423320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:59.423320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 250/510] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:59.423320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.450623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.516714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791e4b-52ea-488d-ac50-d5edc19c3d9a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.523431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd066ddd-cb72-4c92-be4e-d59db800a2e6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.550913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.551597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.551905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.552183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.557667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.558269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.558548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.558825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.559473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:59.559774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.561197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.562545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.563982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.572785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 251/511] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:59.573418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:59.578989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:59.580274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:59.581102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:59.581102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.581102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:59.581102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 261/512] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:59.581102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.625360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.674781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.680165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c9ec1-4731-48b4-aa9e-642c1f76ef55 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.688051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bf38c-1a1c-42a5-bd90-800cb9661c12 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.715465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.716132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.716409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.716687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.721309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.721943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.722196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.722461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.726617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.728096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.733600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.735034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:59.743029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:59.743975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:59.744918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:59.744918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.744918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:11:59.744918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 252/513] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:59.744918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:11:59.749902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:59.750769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:11:59.751641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:11:59.751641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:11:59.751641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:59.751641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 262/514] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:59.751907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.848802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.855243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732a2ce-68e7-4a9f-b4cd-f3448454690b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.855378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce1fcd-9758-4cfb-84bf-771a93149815 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:11:59.888846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.889097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:11:59.889439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.889714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.889816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:11:59.889979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.890066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:11:59.890246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:11:59.890610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:11:59.890907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.892308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.897605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:11:59.899140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:11:59.902194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:11:59.904543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 253/515] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:11:59.905385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:11:59.913108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:11:59.914110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:11:59.914961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 263/516] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:11:59.915782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.008375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c86d3-2d9c-439d-beb6-706b6bb876e8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.019874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e646473-4e4f-46ba-b92b-e171f9d1d7fa None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.041805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.042890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.043162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.043431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.044096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.044392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.045787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.053717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.054313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.054590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.054863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.055498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.055796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.056658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 254/517] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:00.057172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.057451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.072717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 264/518] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:00.073593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.076371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.132760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.159126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfff454-c874-49e1-89cf-da726e75b6ae None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.174738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4af16a-b8bd-4be3-b438-e0c11bf65c1c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.193398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.194007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.194287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.194982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.195636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.195969 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.197351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.207664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.208281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.208557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.208821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 255/519] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:00.208929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.209467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.209628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.210879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.235367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 265/520] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:12:00 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:00.236322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.305871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.335339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6574b6-d946-48e6-87bf-b5a5a9afd09b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.360303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815635-5a61-4b40-8771-fe9df02eeeef None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.375240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.375884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.376159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.376426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.377127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.377485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.378928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.379695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.398307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 256/521] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:00.398892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.407152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.408483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.408483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.408483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.415902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.417143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:00.430844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:00.431748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:00.432716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:00.433165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 266/522] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:00.433934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.531433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bef6b-6841-42fa-a0f5-b816337cee15 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.551696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830429ae-0e55-4dbc-9a7f-d08ffce15431 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.568165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.568960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.569243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.569802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.572592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.579377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.581059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.590095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.590719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.590996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.591263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:00.594718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:00.595614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:12:00.596915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:00.602652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.603175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 257/523] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:00.604211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.604402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:00.616569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:00.617613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:12:00.618500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:00.622609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 267/524] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:00.623483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.662908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.711940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fe2b8-d92d-4822-8492-14b6fdb979e0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.735253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd4b1-5122-4df0-a821-83c54948ae64 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.749177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.749787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.750103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.750465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.751211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=76b507a36c834754bd4ac76935e64b89) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.751522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.753027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.767989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 258/525] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/role_assignments?user.id=76b507a36c834754bd4ac76935e64b89&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:00.767989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.779951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.780678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.781023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.781366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.783520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.783520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.784495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.809184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 268/526] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:00.810165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.849926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.902389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e9f1-163c-47aa-a285-95ae09ab7825 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.922865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:00.943689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad89d-4b15-47d8-9a34-be68c10e475a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:00.955560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.956563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.956989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.957512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.958426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.958901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.960657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:00.983011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 259/527] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:00.984207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:00.988428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:00.989057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:00.989335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:00.989605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:00.991259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:00.991259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:00.992147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:01.036181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 269/528] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:01.036181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:01.110147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3d7fb-d0c3-4211-8525-b9a15eee4ee3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:01.131012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:01.143848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a5fb-73af-4237-9580-8da9453867a3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:01.154948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:01.159030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:01.159320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:01.159598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:01.160409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=8d4b2587bd2c4c5f9e3b8d678432d54b) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:01.160720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:01.163068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:01.168938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 260/529] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:00 2022] GET /identity/v3/role_assignments?user.id=8d4b2587bd2c4c5f9e3b8d678432d54b&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:01.172085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:01.212993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:01.213545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:01.213823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:01.214236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:01.252122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:01.300325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1deb3c-07d9-4149-951a-ba15185dd4de None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:01.319738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:01.321927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:01.340355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:01.341209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:01.341585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:01.342005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:01.419114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:01.464597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:01.465711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:01.471095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 270/530] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:01.474176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:01.570860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:01.626436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81280e5-37ca-4521-9080-7480b236d6e5 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:01.663501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 261/531] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:01.665904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:01.666541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:01.666821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:01.667153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:01.670118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:01.680207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:01.681668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:01.698821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:01.700045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:01.701105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:01.701105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:01.701105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:01.703985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 271/532] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:01.705851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:01.818064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c1fa-4239-41f3-98fc-8b6b3cf2fbf1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:01.826520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:01.861291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:01.868955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:01.869770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:01.870056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:01.870363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:01.871122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:01.871429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:01.872847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:01.892073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 272/533] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:01.895326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:01.914089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc915ba-9b2d-40ee-a791-0b87c3178e61 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:01.990141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:01.990885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:01.991224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:01.991510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.014734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:02.016285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:02.031201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e456d-f0f6-4e33-ad1c-bc240247c392 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:02.043034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:02.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:02.044876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:02.044876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:02.044876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:02.044876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 262/534] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:02.051149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:02.082177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:02.082763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.083042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.083307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.096785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:02.098285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:02.111570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:02.112520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:02.113360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:02.117647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 273/535] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:02.119128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:02.150842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:02.244753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1f1c-e18e-49a5-8cf6-95371582234b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:02.295829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35b38-fed1-4dbe-8ece-6271144f0f70 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:02.299208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:02.299836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.300121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.300393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.301089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:02.301394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:02.302827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:02.322075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 274/536] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:02.323983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:02.381548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:02.382090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.382368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.382637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.383294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:02.383593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:02.385085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:02.387484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:02.411232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 263/537] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:02.416657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:02.418394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:02.435589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bac3e-bdca-4764-a444-9af822b467a3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:02.472138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:02.472740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.473017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.473455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.474189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=344958332b5549558b26d199e53b8b53) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:02.474495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:02.476304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:02.483174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 275/538] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:02 2022] GET /identity/v3/role_assignments?user.id=344958332b5549558b26d199e53b8b53&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:02.597628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad01f55-6f4e-45b1-aa93-b30a4cb54bc2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:02.632289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:02.632848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.633128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.633400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.640596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:02.642104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:02.656211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:02.657136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:02.657968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 264/539] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:02.664712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:02.796484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e9e31-6cc8-42e7-ba9c-611bd409cdf4 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:02.845829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca648607-8b1b-4cc3-bfb5-72a0d8ab319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:02.846804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648607-8b1b-4cc3-bfb5-72a0d8ab319e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.847302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648607-8b1b-4cc3-bfb5-72a0d8ab319e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.847801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648607-8b1b-4cc3-bfb5-72a0d8ab319e None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.848738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca648607-8b1b-4cc3-bfb5-72a0d8ab319e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:02.849236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca648607-8b1b-4cc3-bfb5-72a0d8ab319e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:02.850853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca648607-8b1b-4cc3-bfb5-72a0d8ab319e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:02.865764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 276/540] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:02.872022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:02.890105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0d821-bb27-4bc4-91bc-9d4c7fa8937b None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.890384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0d821-bb27-4bc4-91bc-9d4c7fa8937b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.890634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0d821-bb27-4bc4-91bc-9d4c7fa8937b None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.892257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 277/541] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:02.897787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861d72-9f2a-4552-92c9-7860f8ff3162 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:02.898069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861d72-9f2a-4552-92c9-7860f8ff3162 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:02.898335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861d72-9f2a-4552-92c9-7860f8ff3162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:02.919131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-3c861d72-9f2a-4552-92c9-7860f8ff3162 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:02.920710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-3c861d72-9f2a-4552-92c9-7860f8ff3162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:02.924262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:02.994398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:03.017312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 278/542] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:03.070735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2cad-5077-467f-9d17-d96eb4ef6bb7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:03.119785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da02b3e-9569-4924-a21f-3f8ac8235a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:03.120940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da02b3e-9569-4924-a21f-3f8ac8235a5b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:03.121214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da02b3e-9569-4924-a21f-3f8ac8235a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:03.121482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da02b3e-9569-4924-a21f-3f8ac8235a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:03.122218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da02b3e-9569-4924-a21f-3f8ac8235a5b None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=317574f1c46a45d9b600329f73a993f6) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:03.122524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da02b3e-9569-4924-a21f-3f8ac8235a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:03.124037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da02b3e-9569-4924-a21f-3f8ac8235a5b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:03.132256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 265/543] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:02 2022] GET /identity/v3/role_assignments?user.id=317574f1c46a45d9b600329f73a993f6&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:03.388030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861d72-9f2a-4552-92c9-7860f8ff3162 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:03.454284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fedc-a43b-4d01-b912-ed5b81ce8c0c None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:03.454614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fedc-a43b-4d01-b912-ed5b81ce8c0c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:03.454844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fedc-a43b-4d01-b912-ed5b81ce8c0c None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:03.456528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 266/544] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:03.467415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582bb0-1eb7-49ba-8644-acbff82a244b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:03.467702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582bb0-1eb7-49ba-8644-acbff82a244b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:03.467989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582bb0-1eb7-49ba-8644-acbff82a244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:03.500063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-18582bb0-1eb7-49ba-8644-acbff82a244b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:03.501282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-18582bb0-1eb7-49ba-8644-acbff82a244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:03.543611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861d72-9f2a-4552-92c9-7860f8ff3162 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:03.588707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:03.590250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:03.590726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:03.591224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:03.618355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:03.622486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:03.627714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:03.628630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:03.629418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:03.634864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 279/545] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:03.641379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:03.650365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 267/546] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:12:03.792407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542a65-3507-4138-a815-32a58a694abf None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:03.852705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b325e48-4e52-4744-976d-ff3160984cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:03.853343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b325e48-4e52-4744-976d-ff3160984cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:03.853617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b325e48-4e52-4744-976d-ff3160984cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:03.853889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b325e48-4e52-4744-976d-ff3160984cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:03.854757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b325e48-4e52-4744-976d-ff3160984cd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:03.855070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b325e48-4e52-4744-976d-ff3160984cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:03.856539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b325e48-4e52-4744-976d-ff3160984cd3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:03.866516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 280/547] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:03.873189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18582bb0-1eb7-49ba-8644-acbff82a244b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:03.948113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:03.961140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ba43-b819-43e6-b190-3cf2d2d6c1a9 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:03.961772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ba43-b819-43e6-b190-3cf2d2d6c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:03.962252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ba43-b819-43e6-b190-3cf2d2d6c1a9 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:03.967721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 281/548] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:03.969082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7645-c046-454f-a28d-2f7b97e39844 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:03.969588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7645-c046-454f-a28d-2f7b97e39844 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:03.970059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7645-c046-454f-a28d-2f7b97e39844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.000070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-229e7645-c046-454f-a28d-2f7b97e39844 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:04.001740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-229e7645-c046-454f-a28d-2f7b97e39844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:04.018592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18582bb0-1eb7-49ba-8644-acbff82a244b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.056076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.056997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.057527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.058332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.070584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:04.072233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:04.073361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:04.090817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 282/549] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:04.092019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e7645-c046-454f-a28d-2f7b97e39844 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:04.099340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:04.100398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:04.101813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:04.101813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:04.101813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:04.101813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 268/550] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:04.108795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.213632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e7645-c046-454f-a28d-2f7b97e39844 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.296568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.297569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.298076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.298547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.312767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:04.318508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:04.320027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:04.320948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:04.323935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 283/551] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:04.329503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.356182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:04.362570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550a398-7717-4958-95e9-c0f1e8273eaa None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.390832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:04.441661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.442278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.442559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.442834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.443589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:04.443931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:04.445455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:04.448105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42a09-784a-4a7f-bfef-3b609d1e279c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.459266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 269/552] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:04.460457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.491589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.492559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.493287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.493964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.494791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:04.495853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:04.497345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:04.506787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 284/553] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:04.507968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.572098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347b70f-2737-4380-8c68-5ca049d6bd8e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.615848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.616062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.619854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.619854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.630166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:04.635956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:04.637050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:04.637872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 270/554] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:04.638585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.644270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b041a3-76b1-453c-a317-e12a8b710604 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.660614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:04.670190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:04.687368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.688036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.688313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.688581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.698611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:04.700151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:04.713515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:04.715598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 285/555] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:04.717546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.768004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f65b2-4ca0-4050-b427-54f4632a4de4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.807155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.808319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.808815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.809352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.821711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:04.823716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:04.829312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb266a-7f3a-4965-ac6b-9f0ff3a75842 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:04.841457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:04.842415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:04.843863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:04.843863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:04.843863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:04.850532 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 271/556] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:04.851655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.867314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:04.868042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:04.868281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:04.868548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:04.869207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:04.869502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:04.871184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:04.880276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 286/557] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:04.881160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:04.931420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:04.943610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:04.995168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88798e71-ac0c-424e-a3d2-abb6a228fbb8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.014980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759e61b-5c7c-4680-98f5-f66a2449dc53 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.046224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.047901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.048351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.048925 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.049960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:05.050706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.053717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.063606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.064247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.064523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.064790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.065612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:05.065920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.068327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.078238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 272/558] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:05.079970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.092359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 287/559] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:05.092359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.197335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf7754-8007-4c15-8617-dd9421c47e9a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.208092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:05.216230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af3e22-6f5d-457f-aefd-1c82b7feac13 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.231215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:05.237791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.238857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.239143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.239422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.250004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.251490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.253764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.254884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.255365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.255882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:05.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:05.268579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:05.269573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:05.269573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:05.269573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:05.273113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 273/560] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:05.273897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.338102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.340432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.376615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050d9c-3a79-41df-a2fc-7cd45d704bc0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.414289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a9a2f-e5bf-4ba1-b2f4-02e980dbf50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.415031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9a2f-e5bf-4ba1-b2f4-02e980dbf50a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.415307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9a2f-e5bf-4ba1-b2f4-02e980dbf50a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.415582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9a2f-e5bf-4ba1-b2f4-02e980dbf50a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.424060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a9a2f-e5bf-4ba1-b2f4-02e980dbf50a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.426233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a9a2f-e5bf-4ba1-b2f4-02e980dbf50a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-515a9a2f-e5bf-4ba1-b2f4-02e980dbf50a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:05.441134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:05.442127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 274/561] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509108-bd83-4f93-8632-41752d13260a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.448843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509108-bd83-4f93-8632-41752d13260a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.449586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509108-bd83-4f93-8632-41752d13260a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.450717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:05.451730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 275/562] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:05.452528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1509108-bd83-4f93-8632-41752d13260a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.453625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 288/563] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:05.454367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.505777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:05.567870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0293a1-20f2-4014-bb9b-6316e09c5dad None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.581458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1509108-bd83-4f93-8632-41752d13260a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.608488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7535925-2a85-413f-9ce1-212271e85e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.609099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535925-2a85-413f-9ce1-212271e85e61 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.609379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535925-2a85-413f-9ce1-212271e85e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.609653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535925-2a85-413f-9ce1-212271e85e61 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.610379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7535925-2a85-413f-9ce1-212271e85e61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:05.610682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7535925-2a85-413f-9ce1-212271e85e61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.612148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7535925-2a85-413f-9ce1-212271e85e61 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.617164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.617809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.618091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.618364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.619027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:05.619332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.621252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.630543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 289/564] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:05.631890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd7b4-4618-4ef1-b6ec-1fcf8272b36b None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.632172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd7b4-4618-4ef1-b6ec-1fcf8272b36b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.632440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd7b4-4618-4ef1-b6ec-1fcf8272b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.633967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 276/565] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:05.637266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.652242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-033cd7b4-4618-4ef1-b6ec-1fcf8272b36b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:05.653456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-033cd7b4-4618-4ef1-b6ec-1fcf8272b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:05.702807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:05.720061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 290/566] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:05.721320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c28a93-45fb-44a3-90de-f4045ae0ef68 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.721609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c28a93-45fb-44a3-90de-f4045ae0ef68 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.721882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c28a93-45fb-44a3-90de-f4045ae0ef68 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.723126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 291/567] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:05.723831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c28a93-45fb-44a3-90de-f4045ae0ef68 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.743480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ce634-3e3b-44c8-b1f0-34f0f186ce81 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.746702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:05.785271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.785956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.786238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.786638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.798348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.800158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:05.815839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:05.816780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:05.817655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:05.817655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:05.817655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:05.819362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 277/568] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:05.820312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:05.843523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c28a93-45fb-44a3-90de-f4045ae0ef68 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.882785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c841a-6e47-4ac8-b36e-f09ee134bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.883329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c841a-6e47-4ac8-b36e-f09ee134bf92 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.883602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c841a-6e47-4ac8-b36e-f09ee134bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.883900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c841a-6e47-4ac8-b36e-f09ee134bf92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.894447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c841a-6e47-4ac8-b36e-f09ee134bf92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.895932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c841a-6e47-4ac8-b36e-f09ee134bf92 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-033c841a-6e47-4ac8-b36e-f09ee134bf92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:05.912400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:05.913413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:05.914359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:05.914359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:05.914359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:05.914359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 292/569] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:05.914900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59332416-1c5f-4fd8-ba90-ef8f4764c529 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.914994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59332416-1c5f-4fd8-ba90-ef8f4764c529 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.915610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59332416-1c5f-4fd8-ba90-ef8f4764c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.934413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-59332416-1c5f-4fd8-ba90-ef8f4764c529 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:05.935582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-59332416-1c5f-4fd8-ba90-ef8f4764c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:05.937679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ecf9-87a3-47d7-8c10-1d01bdb2cd2b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:05.965688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:05.975265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:05.975930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:05.976207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:05.976475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:05.985123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:05.986587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:05.999336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:06.000393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 278/570] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:06.001343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.013503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 293/571] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:06.014341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59332416-1c5f-4fd8-ba90-ef8f4764c529 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.018890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.105851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506f483-a32e-47d4-9d6e-c48404e1643e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.129319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59332416-1c5f-4fd8-ba90-ef8f4764c529 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.145573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.146116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.146509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.146781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.147428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:06.147729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.149126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.166227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 279/572] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:06.166227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.168743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.169360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.169640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.169911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.170619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:06.170926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.172327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.190941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 294/573] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:06.190941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.219641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.246607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.272742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709fa4-19bc-4978-9177-9420085b23b9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.298549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67073ee-cdfd-4159-a078-f3439aae970b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.313171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.313806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.314089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.314358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.325130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:06.329943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:06.330877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:06.331731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 280/574] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:06.332448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.339783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.340420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.340706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.340979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.341708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:06.342010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.343427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.360718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 295/575] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:06.361345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.435467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eabb8-b430-4429-89ba-a0d28324b8de None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.445288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.461965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e144b-975d-4fc3-b5a8-9629a191013b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.469139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.469765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.470049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.470322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.472337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.477892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.480269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:06.492445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:06.493480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 281/576] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:06.494710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.500335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.500990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.501243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.501509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.508674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.510651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:06.521745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:06.522778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 296/577] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:06.523681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.598470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef50d8-53dc-40f9-ad4e-07f6cf0e1ac2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.622893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13de5-25d8-4f1e-8441-c622bcd239b7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.634853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.635489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.635802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.636117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.646773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:06.651898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:06.653001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:06.654085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 282/578] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:06.656654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.658998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.659604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.659908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.660179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.660847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:06.661152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.662506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.671091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 297/579] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:06.671919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.680590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.713414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.759693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45affd5e-cb3e-44a4-9825-8de988deae6c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.771715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb905f44-aab5-4b56-b28d-0e53b171e31d None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.793746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.794383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.794665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.794938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.804892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.805461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.806052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.806324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.806414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.806590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.807267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:06.807563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.809637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.821215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 298/580] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:06.821372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:06.822242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:06.823131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:06.823131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:06.823131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:06.823300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.823383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 283/581] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:06.823905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.890859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.927828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f35fbd-6b7f-4de9-ba7a-a4b2a3739b69 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.930923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4f46a-c1c5-478c-989e-2e46bf6c92f7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:06.937857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:06.961671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.962274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.962552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.962823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.963571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:06.964333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.965610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:06.965901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.966087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:06.966301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:06.966575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:06.967254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:06.967558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:06.968959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:06.977077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 284/582] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:06.977895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:06.980205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 299/583] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:06.981387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.079183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51f187-8764-4757-8d93-4ddc337f2af5 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.085974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9365c-2db2-4274-8064-b4fb9965fbc3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.104364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:07.114279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.114878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.115168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.115417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.116170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=59d8c0a83f53476abaac005263ac3bd0) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:07.116478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.117889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.120652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.121282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.121638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.121837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.123317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 300/584] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/role_assignments?user.id=59d8c0a83f53476abaac005263ac3bd0&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:07.123967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.134016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.134766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:07.150771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:07.152620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:07.153509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:07.153509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:07.153509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:07.153509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 285/585] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:07.153509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.181063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:07.255254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6094927-a8d6-44ef-9396-6736f9fd5756 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.280344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2578eb4-0e6b-4691-875d-c07ecf76c8ee None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.294788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.295395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.295670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.295970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.296617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:07.296916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.298305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.311534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 301/586] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:07.312419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.330880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.331522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.331800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.332134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.344208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.345678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:07.360267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:07.361441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:07.362516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:07.362516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:07.362516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:07.366153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 286/587] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:07.367028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.368129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:07.423676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cdd7f-7989-4ef4-b39f-85b46befe8cf None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.442962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:07.462605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.463295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.464402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.464669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/76b507a36c834754bd4ac76935e64b89/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.476696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a02db-3ff8-46d8-a343-10fc7319576b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.479741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=76b507a36c834754bd4ac76935e64b89, role_id=e5343d2ac4f74aa0ab98b62ee8a0c6dd)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.481276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.497804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 302/588] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:07 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/76b507a36c834754bd4ac76935e64b89/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:07.498958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.524155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.525416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.525949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.526915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.527777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:07.528290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.529982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.548418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 287/589] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:07.549709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.641693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:07.645750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694412db-cd63-4998-8c18-c09de92a9180 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.688805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.689447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.689722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.689991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.699647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.701123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.708808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74310985-d09f-4eb3-82dd-524f1d5b42d5 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:07.716235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:07.717159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:07.718050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 303/590] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:07.718531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.759552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:07.767426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.768904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.768904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.768904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.769433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:07.771510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.772958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.798291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 288/591] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:07.799193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.867838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb84d-c6bb-4c33-8841-91453f353611 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.911308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.912188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.912578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.913009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.927847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.927847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:07.951836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:07.952833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:12:07.953757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:07.954292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30e2e0-9618-4fac-bb82-2741e127f0e6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:07.954365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 304/592] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:07.954365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:07.989776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:07.990394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:07.995844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:07.995844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:07.995844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:07.995844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:07.995844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.022975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:08.023315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 289/593] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:08.025713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.124512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d0b51-81b7-46fd-9bf4-f47e3c7f7887 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:08.147113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:08.166696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:08.168253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:08.168787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:08.169257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:08.178372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:08.180332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:08.197278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:08.198958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:12:08.199933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:08.207233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 305/594] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:08.208140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.233802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7af79-ed40-4b57-a322-e7873b535048 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:08.274073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:08.275446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:08.276006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:08.277342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:08.278284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:08.278793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:08.280500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.309900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 290/595] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Sep 14 15:12:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:08.311127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.375221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:08.409969 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5bb01-173b-4ee0-b2da-30cf52b8b143 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:08.450921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:08.451598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:08.452111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:08.452397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/8d4b2587bd2c4c5f9e3b8d678432d54b/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:08.472326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=8d4b2587bd2c4c5f9e3b8d678432d54b, role_id=e5343d2ac4f74aa0ab98b62ee8a0c6dd)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:08.473900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.492434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 306/596] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:08 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/8d4b2587bd2c4c5f9e3b8d678432d54b/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:08.493299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.526736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7e79f-dd15-4fd6-b1f6-b17ba829f1ad None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:08.541075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:08.569826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:08.570840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:08.571378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:08.571968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:08.572961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:08.574049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:08.576063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.600607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 291/597] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Sep 14 15:12:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:08.603521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.639018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e3193-0851-49c7-b352-60fd57d2e285 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:08.705397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:08.719076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:08.720420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:08.722373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:08.722867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:08.744609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:08.747985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:08.766619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:08.767685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:08.768601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:08.768601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:08.768601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:08.774139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 307/598] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:08.776851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.799208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5a1bf-5f59-446c-a1ac-852266c4227b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:08.837642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:08.838280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:08.838560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:08.838923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:08.850661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:08.852281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:08.869597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:08.871172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:08.872696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:08.872696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:08.872696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:08.872696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 292/599] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:08.877317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.891463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6561b23-3b9b-4f50-a0c6-37050202020e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:08.902306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:08.933918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:08.935257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:08.935789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:08.936284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:08.937126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:08.937650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:08.939213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:08.955869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 308/600] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:08.958260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:08.992184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc561295-d5b5-4a67-8c50-239b8966a42f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:09.005310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:09.033404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:09.033999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.034281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.034617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.035321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:09.035631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:09.037822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:09.051467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 293/601] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:09.057121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:09.070056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904f904-531e-41ef-b3dc-871d8015309c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:09.122373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:09.123528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.124253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.124699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.134812 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:09.136563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:09.145309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:09.154434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:09.155357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:09.156271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:09.162030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 309/602] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:09.168578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:09.177604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b341c-fefc-476f-8b11-245b2aaec498 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:09.226260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:09.228162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.230824 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.231306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.246273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:09.250498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:09.274655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:09.275877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:09.277322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:09.284516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 294/603] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:09.290206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:09.333608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fcc9e-d92a-45af-be8d-08312b5e63fe None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:09.337341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:09.381948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:09.382946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.386075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.386822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.387847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:09.391797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:09.393662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:09.422683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 310/604] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:09.424449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:09.532222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207512a-8ea5-4df3-91ab-23aca5b63ca0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:09.535662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941d1ca-9af5-4002-85eb-8bffae566fb0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:09.569317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5be996-4a18-4c51-8d4c-d817a94eba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:09.570321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be996-4a18-4c51-8d4c-d817a94eba5c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.570429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd45496-79b9-446b-a0cf-b2be9c6b2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:09.570908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be996-4a18-4c51-8d4c-d817a94eba5c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.571150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45496-79b9-446b-a0cf-b2be9c6b2801 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.571504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45496-79b9-446b-a0cf-b2be9c6b2801 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.571714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be996-4a18-4c51-8d4c-d817a94eba5c None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.571945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45496-79b9-446b-a0cf-b2be9c6b2801 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/344958332b5549558b26d199e53b8b53/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.572913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5be996-4a18-4c51-8d4c-d817a94eba5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:09.574049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5be996-4a18-4c51-8d4c-d817a94eba5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:09.575758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5be996-4a18-4c51-8d4c-d817a94eba5c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:09.588482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd45496-79b9-446b-a0cf-b2be9c6b2801 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=344958332b5549558b26d199e53b8b53, role_id=e5343d2ac4f74aa0ab98b62ee8a0c6dd)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:09.590042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 295/605] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:09.590787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd45496-79b9-446b-a0cf-b2be9c6b2801 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:09.591855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64925db-524f-428f-a3ce-4aca6864d65b None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.592385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64925db-524f-428f-a3ce-4aca6864d65b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.592836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64925db-524f-428f-a3ce-4aca6864d65b None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.594849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 296/606] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:09.596188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64925db-524f-428f-a3ce-4aca6864d65b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:09.600895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:09.621720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 311/607] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:09 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/344958332b5549558b26d199e53b8b53/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:09.623249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3e16b-128a-4cdc-9e48-803410a7f258 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.623737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3e16b-128a-4cdc-9e48-803410a7f258 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.624190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3e16b-128a-4cdc-9e48-803410a7f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.645650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9ef3e16b-128a-4cdc-9e48-803410a7f258 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:09.647376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9ef3e16b-128a-4cdc-9e48-803410a7f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:09.665010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:09.728179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 312/608] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:09.780078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64925db-524f-428f-a3ce-4aca6864d65b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:09.819077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd8ae0-39d5-4978-81ab-81404cfc7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:09.819749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8ae0-39d5-4978-81ab-81404cfc7958 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:09.820058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8ae0-39d5-4978-81ab-81404cfc7958 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:09.820395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8ae0-39d5-4978-81ab-81404cfc7958 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/317574f1c46a45d9b600329f73a993f6/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:09.838659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd8ae0-39d5-4978-81ab-81404cfc7958 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=317574f1c46a45d9b600329f73a993f6, role_id=e5343d2ac4f74aa0ab98b62ee8a0c6dd)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:09.840860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd8ae0-39d5-4978-81ab-81404cfc7958 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:09.857047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 297/609] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:09 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/317574f1c46a45d9b600329f73a993f6/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:10.057335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3e16b-128a-4cdc-9e48-803410a7f258 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:10.116153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55908cac-bf86-41cc-9d77-ba6d3dfead8d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:10.116721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55908cac-bf86-41cc-9d77-ba6d3dfead8d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:10.116721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55908cac-bf86-41cc-9d77-ba6d3dfead8d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:10.119918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 298/610] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:10.125886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77e0bf-f784-482d-87d4-eac87d54d77d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:10.126147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77e0bf-f784-482d-87d4-eac87d54d77d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:10.126480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77e0bf-f784-482d-87d4-eac87d54d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:10.148634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2d77e0bf-f784-482d-87d4-eac87d54d77d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:10.149988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2d77e0bf-f784-482d-87d4-eac87d54d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:10.166478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3e16b-128a-4cdc-9e48-803410a7f258 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:10.203327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:10.205730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:10.206369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:10.206642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:10.206907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:10.219825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:10.224897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:10.225885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:10.226779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 313/611] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:10.231893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 299/612] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:12:10.234593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:10.239774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:10.353859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114dadf-8e07-4681-a950-d234675011b6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:10.399676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:10.400571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:10.400846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:10.401111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:10.401819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:10.402114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:10.403473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:10.415009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 314/613] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:10.421518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77e0bf-f784-482d-87d4-eac87d54d77d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:10.578755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77e0bf-f784-482d-87d4-eac87d54d77d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:10.584482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:10.641551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:10.642125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:10.642400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:10.642670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:10.661945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:10.663397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:10.690959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:10.692056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:10.692962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:10.692962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:10.692962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:10.692962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 300/614] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:10.704942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:10.705519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:10.752218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:10.796252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f24ce-5de5-4afa-a2f1-8e1d0abf911a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:10.834706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258e8ea-04f7-4cb8-8361-e45d2567cb3e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:10.868133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:10.868771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:10.869045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:10.869313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:10.890684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:10.896147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:10.897112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:10.897958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:10.904679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 315/615] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:10.905628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:10.907185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:10.907827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:10.908220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:10.908488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:10.909139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:10.909438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:10.910820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:10.935859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 301/616] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:10.942782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:11.068981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a312c6-0bb2-446f-b9cb-18c86cf4ae0d None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:11.092209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:11.110215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480aac8-c6ce-4219-ade8-40f9f2fc0b17 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:11.118989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:11.136705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:11.137324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.137600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.137869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.138538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:11.138842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:11.140232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:11.150042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:11.152062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.152496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.152903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.155258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 316/617] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:11.161366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:11.161872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:11.163293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:11.176423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:11.177449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:11.178467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:11.181121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 302/618] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:11.187404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:11.359970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27d09e-2c6e-4d99-bdb8-758f157fe68e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:11.369138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df289217-2783-4d4b-a159-4f60ac771ee6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:11.438642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:11.440087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:11.440869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.441675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.442102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.442521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.443557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:11.444034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.444448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.445255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:11.449083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:11.467031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:11.469519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:11.484297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 303/619] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Sep 14 15:12:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:11.489984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:11.497550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:11.498750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:11.499857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:11.499857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:11.499857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:11.504669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 317/620] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:11.510148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:11.511404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:11.555516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:11.630536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e02-1cf0-4d26-be7e-35ab34a36c5d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:11.636728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de69dd-83a8-409a-ab55-994c8425d78a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:11.673807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef582ebf-31a0-41dc-ac0a-f3b811eb309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:11.674757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582ebf-31a0-41dc-ac0a-f3b811eb309a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.675276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582ebf-31a0-41dc-ac0a-f3b811eb309a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.675555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582ebf-31a0-41dc-ac0a-f3b811eb309a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.682983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98919c3-a435-4125-afda-ad1084ab23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:11.684026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98919c3-a435-4125-afda-ad1084ab23ea None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.684545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98919c3-a435-4125-afda-ad1084ab23ea None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.685037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98919c3-a435-4125-afda-ad1084ab23ea None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.685983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98919c3-a435-4125-afda-ad1084ab23ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:11.686652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98919c3-a435-4125-afda-ad1084ab23ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:11.687455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef582ebf-31a0-41dc-ac0a-f3b811eb309a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:11.688465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98919c3-a435-4125-afda-ad1084ab23ea None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:11.688985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef582ebf-31a0-41dc-ac0a-f3b811eb309a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:11.705160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 318/621] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:11.706912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31685-3137-49c2-9ab3-71a197fee400 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.707412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31685-3137-49c2-9ab3-71a197fee400 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.707929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31685-3137-49c2-9ab3-71a197fee400 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.709729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 319/622] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:11.713553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31685-3137-49c2-9ab3-71a197fee400 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ef582ebf-31a0-41dc-ac0a-f3b811eb309a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:11.716273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:11.717886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:11.718767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:11.718767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:11.718767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:11.718767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 304/623] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:11.719010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745abb-5b63-46b7-8ce9-845d731f85ef None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.719790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745abb-5b63-46b7-8ce9-845d731f85ef None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.719790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745abb-5b63-46b7-8ce9-845d731f85ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.750194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5a745abb-5b63-46b7-8ce9-845d731f85ef None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:11.751385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5a745abb-5b63-46b7-8ce9-845d731f85ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:11.822942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:11.837231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 305/624] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:11.838340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a745abb-5b63-46b7-8ce9-845d731f85ef None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:11.843717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:11.851026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31685-3137-49c2-9ab3-71a197fee400 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:11.920545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:11.921646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:11.923262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:11.923689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:11.940393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:11.942080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:11.970111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:11.971329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:11.972468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:11.974917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 320/625] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:12:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:11.980556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.046262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a745abb-5b63-46b7-8ce9-845d731f85ef None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.116712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.117345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.117625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.117904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.118577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:12.118882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.120397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.145072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 306/626] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:12.145968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.172232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934220-be81-4a1c-8298-a929d966390f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.207057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.207578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.207878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.208149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.208341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:12.209154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:12.209154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.210619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.229943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 321/627] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:12:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:12.230804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.249191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:12.267429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf70f1-1035-4a1e-a2d5-6739f3cf3a21 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.302375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.303008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.303294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.303566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.314081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:12.319374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:12.320439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 307/628] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:12.321283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.342292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ddf14-1ba6-4f8e-aabe-cdc6ec284ebf None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.380975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb950c-7dbe-4e74-a028-335d9cc03ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.382029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb950c-7dbe-4e74-a028-335d9cc03ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.382529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb950c-7dbe-4e74-a028-335d9cc03ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.383011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb950c-7dbe-4e74-a028-335d9cc03ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.391727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb950c-7dbe-4e74-a028-335d9cc03ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.393673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb950c-7dbe-4e74-a028-335d9cc03ad5 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-73eb950c-7dbe-4e74-a028-335d9cc03ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:12.408695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:12.409689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:12.410745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:12.417702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 322/629] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:12.419187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722fad-607e-42b5-bbdc-95e99b2eab86 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.419616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722fad-607e-42b5-bbdc-95e99b2eab86 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.420101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722fad-607e-42b5-bbdc-95e99b2eab86 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.421546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 323/630] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:12.422385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70722fad-607e-42b5-bbdc-95e99b2eab86 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.432734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f7f19-dc4e-4d76-b419-0cf2bc8ae66a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.445550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:12.473683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab6a1-7ff0-4049-a0ee-e0e59814a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.474579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab6a1-7ff0-4049-a0ee-e0e59814a924 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.475022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab6a1-7ff0-4049-a0ee-e0e59814a924 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.475302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab6a1-7ff0-4049-a0ee-e0e59814a924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.504787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:12.530627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70722fad-607e-42b5-bbdc-95e99b2eab86 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.545405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdab6a1-7ff0-4049-a0ee-e0e59814a924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.546852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdab6a1-7ff0-4049-a0ee-e0e59814a924 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.564204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.564803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.565080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.565350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.566012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:12.566312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.567662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.576077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 324/631] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:12.576866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.653513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 308/632] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:12.655014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb6e5-939a-47eb-86ec-1523e0bd585b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.655428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb6e5-939a-47eb-86ec-1523e0bd585b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.655936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb6e5-939a-47eb-86ec-1523e0bd585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.673615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2bceb6e5-939a-47eb-86ec-1523e0bd585b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:12.674825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2bceb6e5-939a-47eb-86ec-1523e0bd585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:12.681606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92478-530a-44a1-b564-30c1e3b82791 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.682223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:12.716552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539a02-bdbe-466a-a681-fd0e4e0b36b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.717154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539a02-bdbe-466a-a681-fd0e4e0b36b6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.717432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539a02-bdbe-466a-a681-fd0e4e0b36b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.717701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539a02-bdbe-466a-a681-fd0e4e0b36b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.718384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539a02-bdbe-466a-a681-fd0e4e0b36b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:12.718685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539a02-bdbe-466a-a681-fd0e4e0b36b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.720141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539a02-bdbe-466a-a681-fd0e4e0b36b6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.727234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:12.732887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 325/633] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:12.734152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa49c8f-a490-431b-8629-cce3bf0b0740 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.734496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa49c8f-a490-431b-8629-cce3bf0b0740 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.734776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa49c8f-a490-431b-8629-cce3bf0b0740 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.735999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 326/634] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:12.736697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa49c8f-a490-431b-8629-cce3bf0b0740 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.746485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 309/635] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:12.747335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb6e5-939a-47eb-86ec-1523e0bd585b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.852961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb6e5-939a-47eb-86ec-1523e0bd585b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.856357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa49c8f-a490-431b-8629-cce3bf0b0740 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:12.889225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.889862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.890145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.890417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.894304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbcae-3260-49b5-8404-d1059c8612e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:12.895215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbcae-3260-49b5-8404-d1059c8612e5 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.895639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbcae-3260-49b5-8404-d1059c8612e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.896097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbcae-3260-49b5-8404-d1059c8612e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.903427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.904917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.907285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:12.909300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbcae-3260-49b5-8404-d1059c8612e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:12.910861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbcae-3260-49b5-8404-d1059c8612e5 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:12.921263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:12.922224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:12.923134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:12.923134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:12.923134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:12.923134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 310/636] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:12.923134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a9adbcae-3260-49b5-8404-d1059c8612e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:12.929295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:12.930462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:12.931555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:12.931555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:12.931555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:12.936095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 327/637] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:12.937598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951a43-d530-4795-ba59-e155f9d71af7 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:12.937958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951a43-d530-4795-ba59-e155f9d71af7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:12.938328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951a43-d530-4795-ba59-e155f9d71af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:12.957972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-b0951a43-d530-4795-ba59-e155f9d71af7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:12.959222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b0951a43-d530-4795-ba59-e155f9d71af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:13.009235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.033049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 328/638] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:13.033989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0951a43-d530-4795-ba59-e155f9d71af7 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.035801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cbd5e-2088-4cdd-9ef5-f03231ed9b34 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.076668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.077347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.077952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.077952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/59d8c0a83f53476abaac005263ac3bd0/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.093605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=59d8c0a83f53476abaac005263ac3bd0, role_id=e5343d2ac4f74aa0ab98b62ee8a0c6dd)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.094811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.107999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 311/639] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:12 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/59d8c0a83f53476abaac005263ac3bd0/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:13.108538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.163756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.179214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0951a43-d530-4795-ba59-e155f9d71af7 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.231584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.232520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.233271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.234120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.235248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:13.235704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.237157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255bee9-22dc-4b40-984b-78904d486c60 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.237832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.256535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 329/640] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:13.257702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.284238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.284878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.285229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.285575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.286352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:13.286720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.288376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.304666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 312/641] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:13.305540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.323324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.386967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366ee15-f072-462b-a1d6-7ade7e552047 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.415197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd955e5-14b1-451f-9955-ae02d7eef0ae None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.418064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.426131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.426849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.427211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.427554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.439061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:13.445246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:13.446197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:13.447049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 330/642] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:13.447737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.462647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.463433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.463902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.464261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.471316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.472837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:13.485658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:13.486677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 313/643] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:13.487585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.567119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.571023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd06a-711a-4e0d-83f0-3e130d08b8cb None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.605045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63413547-3b47-4ff8-9a3a-9034e4181037 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.608554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.609258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.609605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.609944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.621036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.622483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:13.634850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:13.636076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:12:13.637402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:13.640659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 331/644] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:13.641374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.647225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.647895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.648178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.648448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.663002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:13.670514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:13.671493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 314/645] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:13.677274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.705056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.749729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135d7f-870b-4c9e-b000-7a3a0d873166 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.784861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.785464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.785740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.786008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.786553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16608aa-72ee-4c51-a5c6-cc1e342f8e8f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.786679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:13.786982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.788369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.797735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 332/646] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:13.800768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.824007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.824540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.825255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.825595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.826298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:13.826607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.827695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.828137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.843968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 315/647] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:13.845174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.914889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78245-a118-4b5c-b883-ed59ae8ab7b7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.933220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:13.949739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e3a2-6ddf-4588-be4a-a647ed690620 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:13.953444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.954049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.954327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.954598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.955325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:13.955630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.957252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:13.977070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 333/648] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:13.977901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:13.989016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:13.989628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:13.989905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:13.990187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:13.990841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:13.991137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:13.992544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.006218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 316/649] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:14.006218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.067511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:14.090424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cffba9-d4bb-4824-9da6-c8ecd2ff6e4c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.123344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242da78-b3ba-412b-80d3-d16fb685228d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.125603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.126230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.126506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.126775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.137504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.138954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:14.155316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:14.156353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:14.157306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:14.157306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:14.157306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:14.157306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 334/650] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:14.157306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.166165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.166888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.167169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.167442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.168300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=76b507a36c834754bd4ac76935e64b89) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:14.168603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.170571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.187841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 317/651] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/role_assignments?user.id=76b507a36c834754bd4ac76935e64b89&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:14.187841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.191958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:14.305523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b5e68-4d0e-41c2-965b-1c4149d02c09 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.310005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac8b8f-c174-49ba-9225-b958aa1e94b8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.349388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:14.356483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.358775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.358775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.358775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.361810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.362524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.362927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.363203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.379127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.380790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:14.400664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:14.401744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:14.402717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:14.402717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:14.402717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:14.402717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 318/652] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:14.402955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.440834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.442278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.482390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:14.533686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368f71-0b05-465d-aef3-db31ec06b6df None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.565767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 335/653] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:14.566764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.586407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.587724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.588185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.588662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.589457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:14.589918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.591996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.603712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:14.611604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 319/654] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:14.612779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.689268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7be41-5c76-4855-95db-d062702f5c72 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.726464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.727216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.727642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.728001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.728927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:14.729119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.731086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.732711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156529c-b15b-4066-9f33-ff1f48442154 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.743857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 336/655] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:14.745411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.758344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:14.772300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.773187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.773616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.774075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.785503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.787229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:14.805814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:14.806822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:14.808320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:14.808320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:14.808320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:14.810515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 320/656] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:14.811626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.852727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:14.857330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c334f-8b39-406e-95d2-bcb4d9dae16a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.894684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.895749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.895749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.895993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.904710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.906141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:14.918838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:14.920083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:12:14.921154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:14.924208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 337/657] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:14.925114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:14.927126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5b3c2-d3cd-4fcd-a0a0-8923394fa4a4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:14.963793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:14.964766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:14.965227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:14.965647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:14.973849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:14.975551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:14.988082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:14.989283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:12:14.990478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:14.992575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 321/658] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:14.993533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.030645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.038464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d125cb-ac18-4026-970c-49ba84a1339e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.075232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.075869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.076157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.076430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.077072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:15.077662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.079056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.097665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 338/659] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:15.098598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.109069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e823d-5214-4c09-864c-42b6b1255d04 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.114300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.145656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.146349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.146580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.146903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.147644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:15.147983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.149476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.174141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 322/660] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Sep 14 15:12:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:15.174141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.214349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad783-28ac-4d3d-a6ab-403c9397d6dc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.254516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.255409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.255888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.256311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.257201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:15.257659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.259254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.275665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.285828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 339/661] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:15.286967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.287774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362121-b367-4dcc-96b5-3d9673dd78f0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.324936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.327840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.328719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.329048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.338048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.340109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:15.352018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:15.353116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:15.354050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 323/662] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:15.355396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.368990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.402808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620bb02-80ea-4885-add8-bc93693ddcb4 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.442622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fa8a1-1f34-4c9e-909d-6a77694bbfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.443630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fa8a1-1f34-4c9e-909d-6a77694bbfcd None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.443939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fa8a1-1f34-4c9e-909d-6a77694bbfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.444210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fa8a1-1f34-4c9e-909d-6a77694bbfcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.473145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b133-35d6-430d-8ee3-c6a3cd9d9852 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.513784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.514388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.514677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.514945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.515614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fa8a1-1f34-4c9e-909d-6a77694bbfcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.517077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fa8a1-1f34-4c9e-909d-6a77694bbfcd None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.538847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.586582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.592510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.593978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.629893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 340/663] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:15.635505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037b850-a12a-4bf9-91df-8398ab3ad55f None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.635778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037b850-a12a-4bf9-91df-8398ab3ad55f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.636079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037b850-a12a-4bf9-91df-8398ab3ad55f None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.637843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 341/664] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:15.638393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037b850-a12a-4bf9-91df-8398ab3ad55f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.712633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 324/665] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:15.713848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.744326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037b850-a12a-4bf9-91df-8398ab3ad55f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.770972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.785512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ea51d-506c-4856-b56a-9481a61aae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.786113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ea51d-506c-4856-b56a-9481a61aae2f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.786400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ea51d-506c-4856-b56a-9481a61aae2f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.786652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ea51d-506c-4856-b56a-9481a61aae2f None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.787333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ea51d-506c-4856-b56a-9481a61aae2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:15.787628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ea51d-506c-4856-b56a-9481a61aae2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.789058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ea51d-506c-4856-b56a-9481a61aae2f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.806690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 342/666] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:15.806690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ffadb-ec01-46cd-9b80-3deee0819f20 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.806690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ffadb-ec01-46cd-9b80-3deee0819f20 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.806690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ffadb-ec01-46cd-9b80-3deee0819f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.822352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-0a5ffadb-ec01-46cd-9b80-3deee0819f20 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:15.823587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-0a5ffadb-ec01-46cd-9b80-3deee0819f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:15.824675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0cef-6573-4c8d-ab8f-253bf1f3c1cb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:15.849287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:15.864546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:15.865174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:15.865454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:15.865726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:15.877282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:15.878833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:15.893662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:15.894828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:15.895993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:15.895993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:15.895993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:15.896675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 325/667] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:15.897331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:15.916505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 343/668] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:15.916505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ffadb-ec01-46cd-9b80-3deee0819f20 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.016864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ffadb-ec01-46cd-9b80-3deee0819f20 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.033617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1e182-cccb-44ff-8c55-cb41bfcf7ea6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.036161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.058192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.059030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.059728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.060185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.061705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=8d4b2587bd2c4c5f9e3b8d678432d54b) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:16.062166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.063981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.071522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 344/669] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/role_assignments?user.id=8d4b2587bd2c4c5f9e3b8d678432d54b&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:16.071865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.072642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.072905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.073141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.073533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.094659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.096452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.102305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:16.123991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:16.125069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:16.125966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:16.125966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:16.125966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:16.132491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 326/670] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:16.138056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.188566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13380ed-5e59-4d5c-8537-d771c38ee08b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.227698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.228347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.228618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.228881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.230329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:16.230628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.232417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.247029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 345/671] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:16.248454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.292912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aad7c-00e0-482c-ae61-d1b38b8baee2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.335133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.335837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.336062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.336308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.336964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:16.337263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.339205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.355456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.356649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 327/672] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:16.358060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.376951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65359840-255a-4059-8e2c-b145ca70cd47 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.389669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.423685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.424401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.425132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.425132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.439573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:16.444877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:16.446049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:16.447104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:16.452000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 346/673] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:16.453010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.503681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69598a66-2411-4164-8374-4cea9077dfc4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.549386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.550215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.550507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.550778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.559933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.561891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.570701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1d7b-8413-4269-a0c6-85427405c712 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:16.577298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:16.578387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 328/674] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:16.579369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.615101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3fbaf-9a48-4900-aef9-eab010d90d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.615630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3fbaf-9a48-4900-aef9-eab010d90d28 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.615929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3fbaf-9a48-4900-aef9-eab010d90d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.616203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3fbaf-9a48-4900-aef9-eab010d90d28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.623717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3fbaf-9a48-4900-aef9-eab010d90d28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.625180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3fbaf-9a48-4900-aef9-eab010d90d28 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-b6b3fbaf-9a48-4900-aef9-eab010d90d28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:16.637510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:16.638527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:16.639416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 347/675] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:16.639951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbe8c-2ee7-4baf-bf21-6fd1eaef6461 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.640480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbe8c-2ee7-4baf-bf21-6fd1eaef6461 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.640480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbe8c-2ee7-4baf-bf21-6fd1eaef6461 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.643933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 348/676] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:16.643933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbe8c-2ee7-4baf-bf21-6fd1eaef6461 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.649305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.676526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.706033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384de2a-94ed-4cbf-a226-28e22f912c68 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.740344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.740964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.741249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.741503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.742667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:16.742973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.745314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.758913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 329/677] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:16.758913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.770382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbe8c-2ee7-4baf-bf21-6fd1eaef6461 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.809543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b343c-0acb-4e82-87ae-730d34bd728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.810145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b343c-0acb-4e82-87ae-730d34bd728c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.810417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b343c-0acb-4e82-87ae-730d34bd728c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.810680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b343c-0acb-4e82-87ae-730d34bd728c None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.811367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b343c-0acb-4e82-87ae-730d34bd728c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:16.811667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b343c-0acb-4e82-87ae-730d34bd728c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.813108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b343c-0acb-4e82-87ae-730d34bd728c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.826278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 349/678] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:16.827562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d94df-75e8-4edd-84ab-18f48681f9b8 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.827873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d94df-75e8-4edd-84ab-18f48681f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.828144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d94df-75e8-4edd-84ab-18f48681f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.846898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-ce3d94df-75e8-4edd-84ab-18f48681f9b8 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:16.848110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ce3d94df-75e8-4edd-84ab-18f48681f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:16.878382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fc32-b03a-4837-9a2b-1cde6defacea None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:16.913030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.917784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:16.918390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:16.918668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:16.918967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:16.919705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:16.919953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:16.921390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:16.923157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 350/679] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:16.923845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d94df-75e8-4edd-84ab-18f48681f9b8 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:16.939232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:16.947918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 330/680] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:16.953398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.055496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d94df-75e8-4edd-84ab-18f48681f9b8 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.089712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b62915-9ffb-405b-9370-16798234c395 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.105564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.106540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.107350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.108313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.123469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:17.125785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:17.137113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.137726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.138307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.138307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.138988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=344958332b5549558b26d199e53b8b53) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:17.139294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:17.140753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:17.146458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:17.147408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:17.148440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:17.148440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:17.148440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:17.148621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 331/681] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/role_assignments?user.id=344958332b5549558b26d199e53b8b53&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:17.148621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.155163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 351/682] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:17.156876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.215011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:17.255376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:17.284864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ab20-6dc0-4e99-808f-1566e01c65bf None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.303859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b17ddf-5717-4ddf-a774-3183c1d2e533 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.326502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.327531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.328125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.328605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.329468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:17.329982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:17.331856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:17.344555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.345260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.345443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.345849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.347237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=317574f1c46a45d9b600329f73a993f6) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:17.347542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:17.349031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:17.350220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 352/683] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:17.351453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.361326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 332/684] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/role_assignments?user.id=317574f1c46a45d9b600329f73a993f6&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:17.362193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.501398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0c96-e607-4b9f-bd7c-9362cfc61164 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.514652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:17.533861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd2304-469b-4cb7-81cc-6cf21a4fc0c8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.558757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.559411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.559688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.560029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.573723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:17.574485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:17.580229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:17.581170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:17.582020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:17.582663 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 353/685] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:17.589480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.590912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.591562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.591857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.592133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.600899 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:17.603597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:17.620214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:17.621255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:17.622191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 333/686] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:17.627458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.730745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ddcf6-a086-4208-b0ed-d678dd1d2fa8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.756019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a13b-6ebe-4019-a965-b93e5e0f2ea3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:17.770853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.771640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.772041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.772413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.773199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:17.773601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:17.775061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:17.785790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 354/687] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:17.794573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.809649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:17.810749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:17.811249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:17.811877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:17.812827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:17.814230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:17.815977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:17.864115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 334/688] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:17.867667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:17.868861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:17.941404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:17.983515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf359c-75a5-4086-b2ee-6a6746243118 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:18.022826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:18.023458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.023736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.024216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.037211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:18.039230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:18.055538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:18.056558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:18.057493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:18.057493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:18.057493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:18.057493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 355/689] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:18.062806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:18.100561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801689f6-7460-434e-8df5-e6b63be2366b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:18.173941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:18.174561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.174837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.175103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.213533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:18.245583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2561-d076-49c1-9080-a937f20635ce None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:18.313148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:18.314617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:18.320487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:18.321099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.321378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.321643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.322285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:18.322584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:18.324601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:18.339115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 356/690] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:18.344659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:18.427929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:18.491388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84a3d-5ef8-4cf0-bb65-02bc586ac7b9 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:18.551340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 335/691] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:18.553063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:18.553742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.553988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.554259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.558476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:18.572164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:18.573659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:18.580261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:18.591850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:18.592955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:18.593901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:18.594681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 357/692] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:12:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:18.601917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:18.720067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb56f8-c417-4835-b0d8-af47ad87fd50 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:18.757846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87069f53-eab2-462d-9d7f-12f015e37dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:18.758561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069f53-eab2-462d-9d7f-12f015e37dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.758771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069f53-eab2-462d-9d7f-12f015e37dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.759039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069f53-eab2-462d-9d7f-12f015e37dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.761356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f1a2-d283-4c28-afbf-96650dbafb8b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:18.770921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069f53-eab2-462d-9d7f-12f015e37dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:18.772327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069f53-eab2-462d-9d7f-12f015e37dc0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:18.775484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-87069f53-eab2-462d-9d7f-12f015e37dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:18.789389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:18.790394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:18.791331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:18.791331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:18.791331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:18.791331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 336/693] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:18.792641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b7c52-2f5c-4da7-99be-4b0339ffb317 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.792915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b7c52-2f5c-4da7-99be-4b0339ffb317 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.793179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b7c52-2f5c-4da7-99be-4b0339ffb317 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.798728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 337/694] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:18.799542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b7c52-2f5c-4da7-99be-4b0339ffb317 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:18.806997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d90b3-a256-479c-a23e-bcb4d3837276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:18.808484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d90b3-a256-479c-a23e-bcb4d3837276 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.808989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d90b3-a256-479c-a23e-bcb4d3837276 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.809899 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d90b3-a256-479c-a23e-bcb4d3837276 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.810843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d90b3-a256-479c-a23e-bcb4d3837276 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:18.811697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d90b3-a256-479c-a23e-bcb4d3837276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:18.814003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d90b3-a256-479c-a23e-bcb4d3837276 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:18.837390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 358/695] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:12:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:18.840719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4fa85-5d09-4f59-abe9-5adc7a22a9f4 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.841235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4fa85-5d09-4f59-abe9-5adc7a22a9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.841760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4fa85-5d09-4f59-abe9-5adc7a22a9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.864911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-a6a4fa85-5d09-4f59-abe9-5adc7a22a9f4 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:18.866905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-a6a4fa85-5d09-4f59-abe9-5adc7a22a9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:18.925331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b7c52-2f5c-4da7-99be-4b0339ffb317 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:18.938432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:18.955877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 359/696] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:18.957399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4fa85-5d09-4f59-abe9-5adc7a22a9f4 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:18.983267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:18.984267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:18.984752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:18.985224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:18.986069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:18.986714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:18.988361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.001319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 338/697] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:19.006490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.080225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:19.125874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e8566-0245-484e-b17f-852aa76d2a50 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.139225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4fa85-5d09-4f59-abe9-5adc7a22a9f4 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.179177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.179177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.179177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.179177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.214718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.215741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.216294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.216764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.226877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.235973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:19.248041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:19.248963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:19.249863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 339/698] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:19.250351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.266494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:19.281637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.283238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.396950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25ea1-23ba-406c-b291-13f1d65d52bd None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.416281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 360/699] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:19.417765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.418444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:19.445279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.447229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.447674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.448898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.449648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.452275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:19.467516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:19.468831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:19.469885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:19.473113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 340/700] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:19.474087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.529159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:19.543244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4fc6-3659-4e26-a598-851677c033b6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.593664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.597924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.597924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.597924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.597924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:19.598262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.602425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.619066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 361/701] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:19.620600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.629174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678305-3db9-4b62-b89c-d3e11b68b98d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.677306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.678524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.679423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.679937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.695727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.698771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:19.718981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:19.720057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:19.720951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:19.720951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:19.720951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:19.721662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 341/702] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:19.722487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.741723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0e927-f2b6-40e4-b885-4358603f0a72 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.771279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:19.784426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.784967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.785245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.785517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.786486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:19.786738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.788374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.793694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 362/703] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:19.798999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.816630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:19.855346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93df9d-6bef-4044-aa0f-1659179e30c0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.896500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.897512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.897979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.898425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.899355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=59d8c0a83f53476abaac005263ac3bd0) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:19.900031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.901805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.919860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 342/704] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/role_assignments?user.id=59d8c0a83f53476abaac005263ac3bd0&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:19.919860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:19.925118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2638-6f45-4874-a619-2c3b09d16165 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:19.966706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb693-f0f3-401a-abe0-1e00da66a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:19.967596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb693-f0f3-401a-abe0-1e00da66a3be None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.968063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb693-f0f3-401a-abe0-1e00da66a3be None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.968485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb693-f0f3-401a-abe0-1e00da66a3be None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.969309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb693-f0f3-401a-abe0-1e00da66a3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:19.969863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb693-f0f3-401a-abe0-1e00da66a3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:19.971474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb693-f0f3-401a-abe0-1e00da66a3be None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:19.986513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 363/705] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:19.988231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc99d-0f87-4394-849a-680f63ef0409 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.988819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc99d-0f87-4394-849a-680f63ef0409 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.989293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc99d-0f87-4394-849a-680f63ef0409 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:19.990744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 364/706] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:19.997567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676bee-bfcd-46d6-9fe9-564460f7ffdc None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:19.997884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676bee-bfcd-46d6-9fe9-564460f7ffdc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:19.998123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676bee-bfcd-46d6-9fe9-564460f7ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.018055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-bb676bee-bfcd-46d6-9fe9-564460f7ffdc None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:20.019288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-bb676bee-bfcd-46d6-9fe9-564460f7ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:20.043223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:20.049770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6539a0-9946-4d7d-bf72-56a2fc27f85b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:20.088099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:20.088911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.089169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.089987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.090103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:20.090371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:20.091750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:20.099197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 365/707] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:12:20.099362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 343/708] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Sep 14 15:12:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:20.099945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:20.105810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92361b-9122-418e-914a-f49b7ba40629 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.106120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92361b-9122-418e-914a-f49b7ba40629 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.106364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92361b-9122-418e-914a-f49b7ba40629 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.107978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 366/709] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:20.117517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46533d7-8cbd-4fce-8ca5-1c5e776251c7 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.117842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46533d7-8cbd-4fce-8ca5-1c5e776251c7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.118037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46533d7-8cbd-4fce-8ca5-1c5e776251c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.136198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:20.138826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-a46533d7-8cbd-4fce-8ca5-1c5e776251c7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:20.140176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-a46533d7-8cbd-4fce-8ca5-1c5e776251c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:20.233881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 367/710] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:20.243796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc209ab-c31d-4169-963e-b1c9f3a649c7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:20.283169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:20.283847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.284127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.284399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.292877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:20.294417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:20.306550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:20.308075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:20.308971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:20.311894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 344/711] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:20.314365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46533d7-8cbd-4fce-8ca5-1c5e776251c7 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:20.395367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:20.446788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:20.455609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46533d7-8cbd-4fce-8ca5-1c5e776251c7 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:20.506935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:20.524506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:20.525125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.525652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.526537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.527209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:20.527509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:20.528957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:20.541436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 368/712] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:20.548641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:20.559525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a8f49-b6b5-4c8d-9f16-62d70ac61362 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:20.599975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:20.600803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.601230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.601674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.617532 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:20.619245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:20.636238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:20.637338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:20.638257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:20.638257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:20.638257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:20.644959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 345/713] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:20.646149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:20.654420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca280b1-cae0-4982-ac94-6b4c0007412f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:20.691556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:20.692201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.692482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.692755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.693487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=76b507a36c834754bd4ac76935e64b89) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:20.693793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:20.695226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:20.705499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 369/714] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:20 2022] GET /identity/v3/role_assignments?user.id=76b507a36c834754bd4ac76935e64b89&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:20.706638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:20.786348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:20.811925 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:20.835202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45991-09ad-4972-9432-6aaccc3564c3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:20.870650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a13429-e7e2-4b70-a7ef-2274d866a60b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:20.912133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:20.913133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:20.914028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.914908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:20.915415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.916130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.916427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:20.916945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:20.917856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:20.918696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:20.919207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:20.920881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:20.922526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:20.941437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:20.942581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:20.943448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:20.950404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 346/715] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:20 2022] GET /identity/v3/services/network => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:20.953404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 370/716] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:20.959871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:20.961530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:21.100017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606db1-b339-4168-b556-e9bfaea307c0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:21.151521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:21.152169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:21.152449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:21.152723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:21.153359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] RBAC: Adding query filter params (name=network) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:21.153660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:21.155033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:21.163244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:21.171188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 347/717] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:21.172706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9850-c872-42c0-9e83-e90a1ec0ae56 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:21.177020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:21.202399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:21.223775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73156c-f794-4dc7-a450-1998fdeefe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:21.224414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73156c-f794-4dc7-a450-1998fdeefe8f None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:21.225090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73156c-f794-4dc7-a450-1998fdeefe8f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:21.225379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73156c-f794-4dc7-a450-1998fdeefe8f None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:21.226319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73156c-f794-4dc7-a450-1998fdeefe8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:21.228333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73156c-f794-4dc7-a450-1998fdeefe8f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:21.254803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 371/718] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:12:20 2022] POST /identity/v3/users => generated 254 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:21.376468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f462-cf2e-4ed3-bf1e-071c732cb026 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:21.418750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ff698-48dc-4128-8354-f4a29df057bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:21.419366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ff698-48dc-4128-8354-f4a29df057bc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:21.419643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ff698-48dc-4128-8354-f4a29df057bc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:21.419942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ff698-48dc-4128-8354-f4a29df057bc None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:21.420582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ff698-48dc-4128-8354-f4a29df057bc None admin] RBAC: Adding query filter params (type=network) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:21.420881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ff698-48dc-4128-8354-f4a29df057bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:21.422275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ff698-48dc-4128-8354-f4a29df057bc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:21.428473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 348/719] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:22.608713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d592b-23b0-41f3-8db9-003c68589b84 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:22.609315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d592b-23b0-41f3-8db9-003c68589b84 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:22.609315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d592b-23b0-41f3-8db9-003c68589b84 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:22.611009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 372/720] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:22.624995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e143e-782b-41fd-82fb-d697e1c4b20b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:22.625650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e143e-782b-41fd-82fb-d697e1c4b20b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:22.625650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e143e-782b-41fd-82fb-d697e1c4b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:22.652853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a28e143e-782b-41fd-82fb-d697e1c4b20b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:22.654370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a28e143e-782b-41fd-82fb-d697e1c4b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:22.733537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:22.737657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a63f22-da12-4c57-a3de-9d77f10c4906 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:22.738225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a63f22-da12-4c57-a3de-9d77f10c4906 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:22.738225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a63f22-da12-4c57-a3de-9d77f10c4906 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:22.740014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 373/721] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:22.742977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 349/722] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:22.745983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d4f5-0425-4ec7-9e4e-fc5fa97d143c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:22.746267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d4f5-0425-4ec7-9e4e-fc5fa97d143c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:22.746541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d4f5-0425-4ec7-9e4e-fc5fa97d143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:22.779305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-3cf1d4f5-0425-4ec7-9e4e-fc5fa97d143c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:22.780538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-3cf1d4f5-0425-4ec7-9e4e-fc5fa97d143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:22.870755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 374/723] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:23.025949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e143e-782b-41fd-82fb-d697e1c4b20b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:23.146723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e143e-782b-41fd-82fb-d697e1c4b20b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:23.190996 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:23.192047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:23.192576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:23.193153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:23.207699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:23.212875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:23.213872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:23.214730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:23.222033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 350/724] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:23.229413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1d4f5-0425-4ec7-9e4e-fc5fa97d143c None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:23.340986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1d4f5-0425-4ec7-9e4e-fc5fa97d143c None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:23.342920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:23.383586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:23.387296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:23.388215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:23.388661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:23.389164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:23.389992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:23.390428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:23.392000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:23.404153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 375/725] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:23.412309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:23.498176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:23.557831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977e9a6-921c-46bc-b84a-56b9ae2e6d7b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:23.562189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de1cd-e782-4b18-aa43-6136ed678136 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:23.601992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:23.602878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:23.603308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:23.603723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:23.605695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49157b6a-6baa-499a-9fb1-9f3252325d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:23.606598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49157b6a-6baa-499a-9fb1-9f3252325d65 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:23.606881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49157b6a-6baa-499a-9fb1-9f3252325d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:23.607157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49157b6a-6baa-499a-9fb1-9f3252325d65 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:23.608352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49157b6a-6baa-499a-9fb1-9f3252325d65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:23.609748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49157b6a-6baa-499a-9fb1-9f3252325d65 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:23.625127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:23.627681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:23.631148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 351/726] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:12:23 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:23.632644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449611e-a6c5-4b5f-871c-7f624fb8a41b None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:23.632985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449611e-a6c5-4b5f-871c-7f624fb8a41b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:23.633269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449611e-a6c5-4b5f-871c-7f624fb8a41b None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:23.634990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 352/727] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:23.641729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf7be-726a-4b08-b828-fe00288dec60 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:23.642124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf7be-726a-4b08-b828-fe00288dec60 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:23.642408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf7be-726a-4b08-b828-fe00288dec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:23.647708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:23.648789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:23.649681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:23.649681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:23.649681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:23.652407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 376/728] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:23.661939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:23.668554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e1ddf7be-726a-4b08-b828-fe00288dec60 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:23.670097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e1ddf7be-726a-4b08-b828-fe00288dec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:23.714156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:23.769667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 353/729] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:12:23.850054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2937-7bf0-42e7-9ae0-1a53c2354a29 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:23.887648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:23.888296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:23.888573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:23.888847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:23.889490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:23.889792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:23.891209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:23.909034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 377/730] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:23.910508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf7be-726a-4b08-b828-fe00288dec60 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:23.964285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:24.045448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf7be-726a-4b08-b828-fe00288dec60 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:24.082125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:24.082785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.083065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.083336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.092455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:24.093944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:24.108072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:24.109162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:24.110151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:24.112952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 354/731] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:24.115871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:24.136650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:24.214151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:24.237774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3b3b-c753-453d-988f-12f3d56aecec None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:24.261641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:24.265798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c9f7-43ce-42c4-9bf2-c597b3dca2a0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:24.272949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295624e-4795-4163-9b01-76867e8b4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:24.273551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295624e-4795-4163-9b01-76867e8b4a23 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.273822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295624e-4795-4163-9b01-76867e8b4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.274090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295624e-4795-4163-9b01-76867e8b4a23 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.274804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295624e-4795-4163-9b01-76867e8b4a23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:24.275098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295624e-4795-4163-9b01-76867e8b4a23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:24.277309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295624e-4795-4163-9b01-76867e8b4a23 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:24.296736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 378/732] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Sep 14 15:12:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:24.297997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7268c6-56a3-4877-8c22-dd396012fb07 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.298276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7268c6-56a3-4877-8c22-dd396012fb07 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.298540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7268c6-56a3-4877-8c22-dd396012fb07 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.303939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 379/733] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:24.303939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef452e1-8733-4aeb-855f-dae521643ada None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.303939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef452e1-8733-4aeb-855f-dae521643ada None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.303939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef452e1-8733-4aeb-855f-dae521643ada None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.303939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 380/734] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:24.303939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef452e1-8733-4aeb-855f-dae521643ada None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:24.313622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ace81-0010-4624-8d27-f2e9aa892e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:24.314580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ace81-0010-4624-8d27-f2e9aa892e32 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.315064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ace81-0010-4624-8d27-f2e9aa892e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.315541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ace81-0010-4624-8d27-f2e9aa892e32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.333456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ace81-0010-4624-8d27-f2e9aa892e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f67ace81-0010-4624-8d27-f2e9aa892e32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:24.341701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:24.342654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:24.343481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:24.348135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 355/735] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:24.349688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc486de-4178-46cf-8345-1fd1c89e87ba None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.350301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc486de-4178-46cf-8345-1fd1c89e87ba None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.350574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc486de-4178-46cf-8345-1fd1c89e87ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.370960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2cc486de-4178-46cf-8345-1fd1c89e87ba None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:24.372215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2cc486de-4178-46cf-8345-1fd1c89e87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:24.430897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef452e1-8733-4aeb-855f-dae521643ada None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:24.448576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 356/736] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:24.449832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188489-d00e-43db-86f0-3199bba0d2d0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.450114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188489-d00e-43db-86f0-3199bba0d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.450384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188489-d00e-43db-86f0-3199bba0d2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.470084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ef188489-d00e-43db-86f0-3199bba0d2d0 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:24.471611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ef188489-d00e-43db-86f0-3199bba0d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:24.477428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:24.478087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.478364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.478629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.516271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:24.549173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:24.550599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:24.554646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 357/737] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:12:24.555784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188489-d00e-43db-86f0-3199bba0d2d0 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:24.596567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:24.724025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 381/738] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:12:24.730722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:24.746708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188489-d00e-43db-86f0-3199bba0d2d0 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:24.770325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:24.786576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:24.787355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.787565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.787797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.788493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:24.788791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:24.790160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:24.799420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 358/739] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:24.800263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:24.844025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c878-7b50-4fb9-bd40-30df5fe191ba None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:24.887257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:24.888849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.889360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.889847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.895718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:24.904649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:24.906592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:24.918454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00e0f-f40b-4b7d-aedc-66ab6e2603f2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:24.927360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:24.928566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:24.929463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:24.929463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:24.929463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:24.929463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 382/740] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:24.930014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:24.958351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:24.958843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:24.959128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:24.959442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:24.960083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:24.961446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:24.977181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 359/741] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:12:24 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:24.978044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.029093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:25.045635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebfe33-26a8-4d60-a4eb-1457659727c1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.099391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.100489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.100969 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.101448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.113212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.114855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7b3d4-e08f-4b67-9b4a-a576ba9fe33e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.115272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:25.132594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:25.133645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:25.134525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:25.134525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:25.134525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:25.137368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 383/742] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:25.138526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.164697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.165985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.166516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.167155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.185885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:25.195002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:25.196352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:25.197224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 360/743] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:25.198515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.206154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:25.288058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63ef67-dbb6-418f-931c-6582a05bb561 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.326973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7f96-26b8-4920-8d03-4e11c6db48da None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.330242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.330851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.331125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.331393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.332063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:25.332360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.333725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.335394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:25.349350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 384/744] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:25.351368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.372056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.372984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.373473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.373928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.374761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:25.375247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.376866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.395098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 361/745] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:25.396955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.485002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:25.485561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bb453-b3dc-4445-afcf-34426aa79b2f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.524209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.525202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.525967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.526481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.527351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:25.527884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.529454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.536903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab889a98-a3dd-464e-aab7-ab4ee6cb791b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.538676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 385/746] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:25.539933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.576906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.577642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.577919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.578290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.585544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.589224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:25.603774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:25.605276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:25.606251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:25.610358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 362/747] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:25.611240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.624700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:25.680332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9a324-7750-4e1f-a20a-c7da611ba56e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.721721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.722766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.723530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.724640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.727714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f8e6-d499-4aee-95d9-8b6d887d3f45 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.735793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.737534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:25.753057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:25.754709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:25.755901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:25.758275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 386/748] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:25.759401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.766414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:25.783536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.784620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.784997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.785537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.798082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.799653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:25.814867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:25.815986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:25.816878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:25.816878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:25.816878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:25.821360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 363/749] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:25.822317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.890481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587af95-9394-4970-9811-d8bb5edf71c4 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.912260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:25.930226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07407fd-38db-456d-a85d-33c5f11fbe72 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:25.937134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.937997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.939022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.939470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.940368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:25.941243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.943534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:25.964025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 387/750] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:25.964795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:25.973543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:25.974159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:25.974432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:25.974702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:25.975438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:25.976063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:25.977189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.002770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 364/751] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:26.003778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.049980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:26.097055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832898-c78b-41c4-8de6-abd7f702541e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.127252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe44b-938a-4f17-ae40-1bf1794d4e45 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.137228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:26.138341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.138870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.139519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.140537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:26.141116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:26.143603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.159770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 388/752] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:26.161285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.171731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:26.172434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.172716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.172981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.174175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=59d8c0a83f53476abaac005263ac3bd0) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:26.174175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:26.175526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.186471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 365/753] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/role_assignments?user.id=59d8c0a83f53476abaac005263ac3bd0&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:26.186471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.236036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:26.340189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6db7a-33a9-495e-905b-0d30e307913a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.346638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:26.356475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ddc69-d6a0-4c93-aff0-ddfbba7dbe93 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.379439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423757e5-8809-43b9-8d3c-6ebe0d745efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:26.380033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423757e5-8809-43b9-8d3c-6ebe0d745efc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.380308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423757e5-8809-43b9-8d3c-6ebe0d745efc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.380573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423757e5-8809-43b9-8d3c-6ebe0d745efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.393938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423757e5-8809-43b9-8d3c-6ebe0d745efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:26.395387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423757e5-8809-43b9-8d3c-6ebe0d745efc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.402752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e692c97-d914-48f3-b5cd-3c32fe803e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:26.404194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692c97-d914-48f3-b5cd-3c32fe803e38 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.404681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692c97-d914-48f3-b5cd-3c32fe803e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.405556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692c97-d914-48f3-b5cd-3c32fe803e38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-423757e5-8809-43b9-8d3c-6ebe0d745efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:26.411779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:26.412799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:26.413689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:26.413689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:26.413689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:26.416850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e692c97-d914-48f3-b5cd-3c32fe803e38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:26.417705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 389/754] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:26.419044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2582-8efd-4e6f-8192-1c7afb9385f4 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.419321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2582-8efd-4e6f-8192-1c7afb9385f4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.419617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e692c97-d914-48f3-b5cd-3c32fe803e38 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.419720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2582-8efd-4e6f-8192-1c7afb9385f4 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.421239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 390/755] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:26.422060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d2582-8efd-4e6f-8192-1c7afb9385f4 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1e692c97-d914-48f3-b5cd-3c32fe803e38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:26.435550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:26.436756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:26.437860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:26.440424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 366/756] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:26.442045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61f0e-91d9-440e-8b57-4b9633f61637 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.442533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61f0e-91d9-440e-8b57-4b9633f61637 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.442999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61f0e-91d9-440e-8b57-4b9633f61637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.464268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fee61f0e-91d9-440e-8b57-4b9633f61637 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:26.465857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fee61f0e-91d9-440e-8b57-4b9633f61637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:26.528581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:26.545040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d2582-8efd-4e6f-8192-1c7afb9385f4 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.551911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 367/757] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:26.553052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61f0e-91d9-440e-8b57-4b9633f61637 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.590552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:26.591119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.591360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.591627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.592278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:26.592567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:26.593926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.626412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 391/758] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:26.628970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.709274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:26.741892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61f0e-91d9-440e-8b57-4b9633f61637 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.778040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901816d8-4535-4779-9cd6-b28a05dca624 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.816882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:26.817855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.818329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.818830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.826328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:26.828092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:26.840430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:26.841696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:26.842810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:26.843388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:26.843388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:26.843388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:26.843388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:26.844124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:26.844124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:26.844246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:26.846153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 392/759] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:26.847274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.868479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 368/760] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:26.870413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:26.873956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:26.971605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc55863-6673-441e-b829-3296604b05b0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:26.977490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b110171-60ee-448a-875d-6267e32d90ab None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.011989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.012758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.013098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.013435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.014805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.015622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.017201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.018022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.018485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.018954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.019862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:27.020377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.022010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:27.030638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:27.031693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:27.037003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 393/761] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:27.037805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:27.050774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 369/762] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:27.052087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:27.057522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:27.128353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:27.161409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4b91-9230-479c-9e9f-79900909eeee None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.164923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a43b79-9d74-4a27-a05e-a86d4c0ab855 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.200322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.201373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.201876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.202418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.203316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:27.203853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.205467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.207432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08432a2c-2436-4612-806c-09b1ac6309eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.208182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432a2c-2436-4612-806c-09b1ac6309eb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.208456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432a2c-2436-4612-806c-09b1ac6309eb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.208722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432a2c-2436-4612-806c-09b1ac6309eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.216911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 370/763] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Sep 14 15:12:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:27.218071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:27.301940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08432a2c-2436-4612-806c-09b1ac6309eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.304001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08432a2c-2436-4612-806c-09b1ac6309eb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.328380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:27.372171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8cb8-8f4a-4c97-af12-fec0334c610d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.411256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.411956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.412246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.412540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/76b507a36c834754bd4ac76935e64b89/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.414529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=76b507a36c834754bd4ac76935e64b89, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.416037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.416556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:27.436106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 371/764] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:27 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/76b507a36c834754bd4ac76935e64b89/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:27.436106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:27.471158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 394/765] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:12:27.474013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759310e2-28c4-4e2b-b4c1-64acc540e1dc None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.474772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759310e2-28c4-4e2b-b4c1-64acc540e1dc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.475441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759310e2-28c4-4e2b-b4c1-64acc540e1dc None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.478649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 395/766] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:27.482065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759310e2-28c4-4e2b-b4c1-64acc540e1dc None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:27.630537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759310e2-28c4-4e2b-b4c1-64acc540e1dc None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.634412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db985ff-7464-45fe-b9a1-d84e110f8c8e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.668661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:27.679160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2c0f0-ad5d-4447-b96e-60969db7eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.679771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2c0f0-ad5d-4447-b96e-60969db7eb12 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.680101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2c0f0-ad5d-4447-b96e-60969db7eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.680376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2c0f0-ad5d-4447-b96e-60969db7eb12 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.681012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2c0f0-ad5d-4447-b96e-60969db7eb12 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:27.681321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2c0f0-ad5d-4447-b96e-60969db7eb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.682806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.683235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2c0f0-ad5d-4447-b96e-60969db7eb12 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.683428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.683696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.684027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.689111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 372/767] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Sep 14 15:12:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:27.693523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d20a7-a321-4b34-8c29-f1d9518e968f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.693818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d20a7-a321-4b34-8c29-f1d9518e968f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.694093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d20a7-a321-4b34-8c29-f1d9518e968f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.701804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.703588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.714230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-be1d20a7-a321-4b34-8c29-f1d9518e968f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:27.715511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-be1d20a7-a321-4b34-8c29-f1d9518e968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:27.720041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:27.721400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:27.722935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:27.722935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:27.722935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:27.722935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 396/768] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:27.723373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:27.751331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:27.813139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 373/769] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:27.814355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d20a7-a321-4b34-8c29-f1d9518e968f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:27.870045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bce3fe-b034-421d-bc70-2c2c02c9844a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.935637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d20a7-a321-4b34-8c29-f1d9518e968f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:27.958163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:27.958792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:27.959063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:27.959333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:27.960076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] RBAC: Adding query filter params (interface=public, service_id=491ece5fe1ab453b99d43e0637124bdb, region_id=RegionOne) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:27.960382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:27.961742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:27.984588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:27.985209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 397/770] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:12:27 2022] GET /identity/v3/endpoints?service_id=491ece5fe1ab453b99d43e0637124bdb&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:27.990771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.009875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.010570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.010850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.011125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.011848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:28.012185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.013541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.035891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 374/771] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:28.043276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.097499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:28.111462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bde03-54ab-4946-a2cf-d983f3a0d3fe None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:28.148088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.149800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.150084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.150606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.151736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.156035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.165906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 398/772] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:12:27 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:28.191769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.223427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aa73e-32fb-482c-b0a9-db10dcae1787 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:28.296884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.297548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.297821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.298089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.316668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.320582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:28.349073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:28.350045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:28.350922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:28.357894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 375/773] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:28.365155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.372662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61198c1-c72c-44c8-8646-d8b7744e9071 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:28.409717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.410639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.410992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.411235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.411875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.413199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:28.422494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:28.423541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:28.424802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 399/774] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:28 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:28.429921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.449141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:28.460265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:28.510881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1de59-71a6-4902-b5e3-c127fbc4cb33 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:28.541914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123fea-6f89-4869-9f73-d163af12aca2 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:28.556000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.557983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.558479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.558956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.560019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:28.560654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.562289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.579861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 376/775] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:28.582115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.582882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.583285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.583694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.584470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] RBAC: Adding query filter params (name=network) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:28.585478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.586717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.590595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.606915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 400/776] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:28.618955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.718868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:28.742191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9854f2e-02c0-40d8-8a1e-c2276f27c149 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:28.743226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1797d-4d67-49cc-9a5d-05d5f91107cb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:28.746485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:28.781416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a4ced-6ff6-4e12-81d1-3ae81ee0bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.782020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a4ced-6ff6-4e12-81d1-3ae81ee0bf0c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.782292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a4ced-6ff6-4e12-81d1-3ae81ee0bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.782554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a4ced-6ff6-4e12-81d1-3ae81ee0bf0c None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.783344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a4ced-6ff6-4e12-81d1-3ae81ee0bf0c None admin] RBAC: Adding query filter params (type=network) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:28.783638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a4ced-6ff6-4e12-81d1-3ae81ee0bf0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.785666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a4ced-6ff6-4e12-81d1-3ae81ee0bf0c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.789277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e55d85-e144-4ff5-97ed-f5306ef8a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:28.790426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e55d85-e144-4ff5-97ed-f5306ef8a64b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.790851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e55d85-e144-4ff5-97ed-f5306ef8a64b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.791303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e55d85-e144-4ff5-97ed-f5306ef8a64b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.792000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 401/777] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:28.796891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e55d85-e144-4ff5-97ed-f5306ef8a64b None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=09dd7aa113ee4a83b06726b37b522eaa) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:28.797047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7301-f809-42e1-a217-2c9d9e8b4cf9 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.797047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7301-f809-42e1-a217-2c9d9e8b4cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.797047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7301-f809-42e1-a217-2c9d9e8b4cf9 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.797678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e55d85-e144-4ff5-97ed-f5306ef8a64b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:28.798977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 402/778] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:28.799437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e55d85-e144-4ff5-97ed-f5306ef8a64b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:28.799745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d7301-f809-42e1-a217-2c9d9e8b4cf9 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:28.810398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 377/779] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:28 2022] GET /identity/v3/role_assignments?user.id=09dd7aa113ee4a83b06726b37b522eaa&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:28.811971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef03a1-a4c6-4c97-8e4c-3af66edbd04b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:28.812859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef03a1-a4c6-4c97-8e4c-3af66edbd04b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:28.813364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef03a1-a4c6-4c97-8e4c-3af66edbd04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:28.851130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ccef03a1-a4c6-4c97-8e4c-3af66edbd04b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:28.852399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ccef03a1-a4c6-4c97-8e4c-3af66edbd04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:29.011081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 378/780] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:29.012549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d7301-f809-42e1-a217-2c9d9e8b4cf9 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:29.062860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:29.063876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:29.064368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:29.064842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:29.065761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] RBAC: Adding query filter params (interface=public, service_id=4c69be4f8b7a4fd3ab66b3c8a6e285f7, region_id=RegionOne) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:29.066271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:29.067927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:29.082673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 403/781] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:12:28 2022] GET /identity/v3/endpoints?service_id=4c69be4f8b7a4fd3ab66b3c8a6e285f7&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:29.089342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef03a1-a4c6-4c97-8e4c-3af66edbd04b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:29.215836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef03a1-a4c6-4c97-8e4c-3af66edbd04b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:29.220018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:29.264661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:29.265617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:29.266131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:29.266603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:29.267427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:29.269073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:29.280826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 379/782] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:12:29 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:29.366741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:29.382321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:29.496579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91f95f-64ab-44de-8c6e-fc7fd03e1eae None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:29.537071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:29.537630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:29.537901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:29.538168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:29.554062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:29.559408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:29.560364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:29.561800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 404/783] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:29.566581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:29.689326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b65fd6-38ac-4127-a4d6-a62f2d1a853f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:29.736391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:29.737005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:29.737285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:29.737555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:29.738229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:29.738531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:29.739937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:29.752746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 380/784] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:29.758826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:29.868355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:29.910610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467283d-8049-45e3-8e35-1fcc47bf821e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:29.958096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760ac38-9558-4a2d-bcc7-c9aeec2c497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:29.959096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760ac38-9558-4a2d-bcc7-c9aeec2c497c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:29.959584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760ac38-9558-4a2d-bcc7-c9aeec2c497c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:29.960105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760ac38-9558-4a2d-bcc7-c9aeec2c497c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:29.978516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760ac38-9558-4a2d-bcc7-c9aeec2c497c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:29.980458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760ac38-9558-4a2d-bcc7-c9aeec2c497c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-6760ac38-9558-4a2d-bcc7-c9aeec2c497c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:30.001065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:30.002101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:30.002995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:30.002995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:30.002995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:30.007838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 405/785] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:30.011308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:30.062521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:30.121269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4562f-dc8b-4b96-a5fe-b330d35b9a21 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:30.122211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4562f-dc8b-4b96-a5fe-b330d35b9a21 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:30.122698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4562f-dc8b-4b96-a5fe-b330d35b9a21 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:30.124539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 406/786] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:30.129674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb6aa-943f-4e8c-b812-6757c0f2b473 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:30.129957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb6aa-943f-4e8c-b812-6757c0f2b473 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:30.130228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb6aa-943f-4e8c-b812-6757c0f2b473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:30.151520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-756fb6aa-943f-4e8c-b812-6757c0f2b473 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:30.152828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-756fb6aa-943f-4e8c-b812-6757c0f2b473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:30.171732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78767f1-66c9-4fa1-939e-9285204cb7e6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:30.237898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 407/787] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:30.249193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57443203-d721-4616-935a-6471838d34d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:30.249803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57443203-d721-4616-935a-6471838d34d7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:30.250076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57443203-d721-4616-935a-6471838d34d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:30.250345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57443203-d721-4616-935a-6471838d34d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:30.250990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57443203-d721-4616-935a-6471838d34d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:30.251291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57443203-d721-4616-935a-6471838d34d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:30.252682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57443203-d721-4616-935a-6471838d34d7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:30.265612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 381/788] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:30.272970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fb6aa-943f-4e8c-b812-6757c0f2b473 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:30.464187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:30.507300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fb6aa-943f-4e8c-b812-6757c0f2b473 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:30.542544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:30.543174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:30.543443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:30.543703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:30.551581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:30.553105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:30.566820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:30.568090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:30.569431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 408/789] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:30.573155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57443203-d721-4616-935a-6471838d34d7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:30.574786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:30.684826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da161b3b-3094-4046-a772-9b66d44019d8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:30.696687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:30.721635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:30.722690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:30.722960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:30.723224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:30.723980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:30.724277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:30.725688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:30.745814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 409/790] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Sep 14 15:12:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:30.751326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:30.776551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:30.800107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57443203-d721-4616-935a-6471838d34d7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:30.842677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:30.843880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:30.844324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:30.845250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:30.859044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:30.864229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:30.865325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:30.866325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:30.869154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 382/791] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:30.874543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:30.965011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3b11f-bca7-4069-994f-8e1c62440216 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.009066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1c3b3-74e7-4979-bd8e-05bc7457c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.010075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c3b3-74e7-4979-bd8e-05bc7457c096 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.010492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c3b3-74e7-4979-bd8e-05bc7457c096 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.011121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c3b3-74e7-4979-bd8e-05bc7457c096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.017877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cc2a6-4bc7-47bb-af08-5080467e1968 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.025269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c3b3-74e7-4979-bd8e-05bc7457c096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.028301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c3b3-74e7-4979-bd8e-05bc7457c096 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a0a1c3b3-74e7-4979-bd8e-05bc7457c096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:31.051355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:31.052590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:31.053688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:31.053688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:31.053688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:31.056274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 410/792] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:31.058295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18622e-0c3b-4492-b433-918ac56dd75c None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.058977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18622e-0c3b-4492-b433-918ac56dd75c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.059643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18622e-0c3b-4492-b433-918ac56dd75c None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.062335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 411/793] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:31.063250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18622e-0c3b-4492-b433-918ac56dd75c None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.071182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46535b50-d76b-48bf-bd53-fd28ecbd08de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.072042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535b50-d76b-48bf-bd53-fd28ecbd08de None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.072595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535b50-d76b-48bf-bd53-fd28ecbd08de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.073220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535b50-d76b-48bf-bd53-fd28ecbd08de None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.074776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535b50-d76b-48bf-bd53-fd28ecbd08de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:31.075542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535b50-d76b-48bf-bd53-fd28ecbd08de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.078600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535b50-d76b-48bf-bd53-fd28ecbd08de None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.090329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:31.090945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 383/794] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:31.093229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dc5af-8587-4dea-adcd-8b6eb1807d63 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.093847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dc5af-8587-4dea-adcd-8b6eb1807d63 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.094437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dc5af-8587-4dea-adcd-8b6eb1807d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.106838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:31.122284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6a0dc5af-8587-4dea-adcd-8b6eb1807d63 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:31.124135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6a0dc5af-8587-4dea-adcd-8b6eb1807d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:31.196905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18622e-0c3b-4492-b433-918ac56dd75c None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.224165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 384/795] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:31.224165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dc5af-8587-4dea-adcd-8b6eb1807d63 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.257463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.258064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.259781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.261528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.262181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:31.264275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.265648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.288713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 412/796] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:31.295213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.426931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dc5af-8587-4dea-adcd-8b6eb1807d63 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.450118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:31.467520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.468299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.468551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.468827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.474571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9913a0-c287-49fb-b847-0eca12eb05d0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.479573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.480123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:31.492151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.512895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953af80-6281-445a-80a0-9a75f65d0e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.513850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953af80-6281-445a-80a0-9a75f65d0e98 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.514331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953af80-6281-445a-80a0-9a75f65d0e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.514805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953af80-6281-445a-80a0-9a75f65d0e98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:31.521517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:31.522468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:31.523364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:31.523364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:31.523364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:31.523364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 385/797] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:31.524972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953af80-6281-445a-80a0-9a75f65d0e98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.528537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953af80-6281-445a-80a0-9a75f65d0e98 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.529338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-4953af80-6281-445a-80a0-9a75f65d0e98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:31.544309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:31.545290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:31.546198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 413/798] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:31.548139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aea99-cf7f-405c-b9dd-51817bac6645 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.548427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aea99-cf7f-405c-b9dd-51817bac6645 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.548699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aea99-cf7f-405c-b9dd-51817bac6645 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.550129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 414/799] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:31.550703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aea99-cf7f-405c-b9dd-51817bac6645 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.651388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aa762-26b6-4f40-8609-bf6b528c0301 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.672493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aea99-cf7f-405c-b9dd-51817bac6645 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.686829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.687434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.687710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.688004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.688642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:31.688939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.690323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.708162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 386/800] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:31.708162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.716708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b06b5-5dc9-4710-9bbb-3b59a35524f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.717431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b06b5-5dc9-4710-9bbb-3b59a35524f9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.717680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b06b5-5dc9-4710-9bbb-3b59a35524f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.717942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b06b5-5dc9-4710-9bbb-3b59a35524f9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.718523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b06b5-5dc9-4710-9bbb-3b59a35524f9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.720226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b06b5-5dc9-4710-9bbb-3b59a35524f9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-0c2b06b5-5dc9-4710-9bbb-3b59a35524f9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:31.729075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:31.730044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:31.730923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 415/801] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:31.731745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f254a-a0ee-48a3-a6ca-29b683191091 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.731745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f254a-a0ee-48a3-a6ca-29b683191091 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.732590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f254a-a0ee-48a3-a6ca-29b683191091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.740400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:31.752253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-f57f254a-a0ee-48a3-a6ca-29b683191091 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:31.753438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-f57f254a-a0ee-48a3-a6ca-29b683191091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:31.764222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:31.819582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cb79f-2b3d-49fd-b596-b9fa9d594c38 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.833108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 416/802] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:31.834043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f254a-a0ee-48a3-a6ca-29b683191091 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.856647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:31.858087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:31.858685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:31.859121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:31.860192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:31.860649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:31.863035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:31.881640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 387/803] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:31.881640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:31.968109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f254a-a0ee-48a3-a6ca-29b683191091 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.987452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0047-4cd2-4be3-83fe-06793c314834 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:31.995560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:32.008559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636a2df-11e4-499a-b972-636fae868ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.009419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a2df-11e4-499a-b972-636fae868ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.009845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a2df-11e4-499a-b972-636fae868ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.010801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a2df-11e4-499a-b972-636fae868ab6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.020221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:32.024454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636a2df-11e4-499a-b972-636fae868ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.027711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636a2df-11e4-499a-b972-636fae868ab6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.028393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.029132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.029514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.029889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.030628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:32.031034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.032709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.041090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 388/804] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:32.041984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-d636a2df-11e4-499a-b972-636fae868ab6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:32.042142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:32.043017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:12:32.044224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:32.046545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 417/805] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:12:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:32.048867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cff63-93c2-41c0-8798-e3d797391373 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.049247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cff63-93c2-41c0-8798-e3d797391373 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.049636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cff63-93c2-41c0-8798-e3d797391373 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.052089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 418/806] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:32.052948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cff63-93c2-41c0-8798-e3d797391373 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.151939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6374fa-a565-4446-ad18-e64327c44ea0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:32.166830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cff63-93c2-41c0-8798-e3d797391373 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:32.185151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.185962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.186240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.186647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/59d8c0a83f53476abaac005263ac3bd0/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.188961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=59d8c0a83f53476abaac005263ac3bd0, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.190413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.200334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3788f08-c123-4b0a-a5ba-e5e090a8a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.200997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788f08-c123-4b0a-a5ba-e5e090a8a252 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.201274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788f08-c123-4b0a-a5ba-e5e090a8a252 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.201546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788f08-c123-4b0a-a5ba-e5e090a8a252 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.202226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3788f08-c123-4b0a-a5ba-e5e090a8a252 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:32.202530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3788f08-c123-4b0a-a5ba-e5e090a8a252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.203243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 389/807] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:32 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/59d8c0a83f53476abaac005263ac3bd0/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:32.203983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3788f08-c123-4b0a-a5ba-e5e090a8a252 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.204087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.215850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 419/808] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Sep 14 15:12:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:32.222006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8aff-98b4-479d-91e7-1619a6e71b69 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.222353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8aff-98b4-479d-91e7-1619a6e71b69 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.222903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8aff-98b4-479d-91e7-1619a6e71b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.243746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:32.246617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-decf8aff-98b4-479d-91e7-1619a6e71b69 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:32.248074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-decf8aff-98b4-479d-91e7-1619a6e71b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:32.316308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:32.330000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638168fc-b116-47b9-a275-2261c6455da7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:32.336806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 420/809] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:32.336806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8aff-98b4-479d-91e7-1619a6e71b69 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.375764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.376466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.376739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.377006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.377739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:32.378035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.379712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.461943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8aff-98b4-479d-91e7-1619a6e71b69 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:32.504577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.505704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.506273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.506683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.518822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 390/810] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:12:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:32.521239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:32.524192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:32.527344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:32.528400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:32.529266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:32.532431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 421/811] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:32.533437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.608486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:32.639271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:32.653761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358cb3-a3bc-4365-b524-51b694d89d98 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:32.673443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9cae-99be-44aa-8e87-6e0ca49bfd3c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:32.692298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.692910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.693180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.693441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.694540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.696099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.711012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.711634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.712021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.712221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.727846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 391/812] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:12:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:32.727846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.808987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.811503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.873757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:32.886318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113b908-77f3-42f9-bae2-76bc39eeb6b4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:32.925439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:32.926248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:32.927597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:32.927597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:32.927597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:32.928100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:32.929570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:32.939889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 422/814] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:12:32.940079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 392/814] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:32.940756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.949964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:32.954793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:33.063562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a682-64f9-46a6-8cdb-213b5058ae6a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.068614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192a592-3ba4-42d7-8ffd-76b8d7c74ddc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.102501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.103697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.104777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.105252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] PATH_INFO: `/v3/services/network` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.105623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.106245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.106521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.106624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.106779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.108383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.117414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:33.118484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:33.119568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:12:33.120534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:33.121706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.124481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 423/815] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:32 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:33.126272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:33.144986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:33.146420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:33.147703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:33.147703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:33.147703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:33.151994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:33.152134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 393/816] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:33.154099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.227227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:33.269618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f4897-b10d-403c-886a-7137e603d405 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.277568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60332ab-93f5-453e-8a70-9491b8b6f9d3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.308863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.309847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.310331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.310805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.316077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.316686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.316961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.317230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.317862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] RBAC: Adding query filter params (name=network) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:33.324509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.324509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.328810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.329596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 394/817] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:33.330360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.330473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:33.345886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:33.346875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:33.347779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:33.347779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:33.347779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:33.347779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 424/818] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:33.348077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.412854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:33.455335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7242b66-38a3-4591-9733-b89f0e1afd0c None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.458993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd636bf0-dc5a-4e02-b569-ec4ccc9cea14 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.492575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.493189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.493469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.493739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.494672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] RBAC: Adding query filter params (type=network) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:33.494784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.496095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.496233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:33.506362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 425/819] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:33.506362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.512154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.513066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.513640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.514112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.515515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:33.516052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.518627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.544197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 395/820] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:33.545197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.638905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948c0d-6b31-43d9-b62b-6b18ace9bd83 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.677351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:33.683530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325ce2a-6243-4a12-969b-92dd94adf793 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.689004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.689804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.690227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.690661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.691444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:33.692397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.694417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.713691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 426/821] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:33.713691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.735175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.736081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.736660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.737080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:33.738245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:33.740119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:33.769735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 396/822] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:12:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:33.769735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:33.859411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:33.910260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d57d-cbfd-4005-a72d-21ed10c400b0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.992823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22d77f-6df4-42f0-a2f8-0709a27b17fd None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:33.995368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:33.996026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:33.996303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:33.996648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.013071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.014537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:34.032136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:34.033161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:34.034153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:34.042695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 427/823] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:12:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:34.044400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:34.047981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:34.048684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.048968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.049268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.060292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.061424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:34.074072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:34.076551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:34.077474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 397/824] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:34.085091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:34.108066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:34.173880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcac6b-7172-431f-b5ce-7cda61b214e0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:34.197280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:34.204977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4d8d4-8427-4b77-9ab2-9a0debd71c78 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:34.218808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:34.219419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.219696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.220016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.220860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:34.221174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.222708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.242184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 428/825] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Sep 14 15:12:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:34.245153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:34.245942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.246374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.246786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.247621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:34.248095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.248224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:34.249903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.264766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 398/826] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:34.271146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:34.367960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c13d3-4142-4337-8b21-3d3274afb9e9 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:34.370151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:34.385855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f72fd0-e2b1-46dc-9ad1-8db7ce878791 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:34.414600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08784c25-82d5-42d1-9cf5-d5d25fb191dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:34.415287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784c25-82d5-42d1-9cf5-d5d25fb191dc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.415617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784c25-82d5-42d1-9cf5-d5d25fb191dc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.416550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784c25-82d5-42d1-9cf5-d5d25fb191dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.424675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:34.425592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.426017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.426431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.427248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08784c25-82d5-42d1-9cf5-d5d25fb191dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.427508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=76b507a36c834754bd4ac76935e64b89) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:34.427987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.428954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08784c25-82d5-42d1-9cf5-d5d25fb191dc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.429718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.442648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 399/827] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:34 2022] GET /identity/v3/role_assignments?user.id=76b507a36c834754bd4ac76935e64b89&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-08784c25-82d5-42d1-9cf5-d5d25fb191dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:34.445862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:34.447048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:34.448233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:34.448233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:34.448233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:34.449291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 429/828] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:34.455447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:34.488776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:34.572802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277dd1-97c6-492d-9616-ada12ddfe35d None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.573439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277dd1-97c6-492d-9616-ada12ddfe35d None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.574040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277dd1-97c6-492d-9616-ada12ddfe35d None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.576081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 430/829] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:34.583855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372fd6e-7827-4c73-bcf3-60ef035d3f27 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.583855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372fd6e-7827-4c73-bcf3-60ef035d3f27 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.583855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372fd6e-7827-4c73-bcf3-60ef035d3f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.584325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6297f-a8f2-4b0d-83f0-fa677c341010 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:34.608553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-2372fd6e-7827-4c73-bcf3-60ef035d3f27 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:34.609764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-2372fd6e-7827-4c73-bcf3-60ef035d3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:34.625543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:34.626521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.626893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.627262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.628177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:34.628578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.630107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.648274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 400/830] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:34.654524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:34.706183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 431/831] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:34.753498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:34.776758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670e519-ccf1-4fde-850d-f3f294d3013f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:34.816843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:34.817765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:34.818196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:34.818618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:34.826137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:34.827765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:34.840323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:34.841452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:34.842582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:34.844650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 401/832] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:34.850576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372fd6e-7827-4c73-bcf3-60ef035d3f27 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:34.949188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:34.962597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372fd6e-7827-4c73-bcf3-60ef035d3f27 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:35.002107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:35.002719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.002992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.003432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.004008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:35.004314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:35.005009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.007858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:35.019001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 432/833] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:35.026457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.126448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444662f3-db86-494f-95eb-009676e26d59 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:35.160118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf203b-120b-4faf-8867-af5f33085dfd None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:35.165779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d02b1-337b-4977-a36f-0da885f539dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:35.167104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d02b1-337b-4977-a36f-0da885f539dd None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.167423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d02b1-337b-4977-a36f-0da885f539dd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.167699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d02b1-337b-4977-a36f-0da885f539dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.178166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:35.184004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d02b1-337b-4977-a36f-0da885f539dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-462d02b1-337b-4977-a36f-0da885f539dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:35.189208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:35.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:35.193064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 402/834] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:35.194224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb87b-33e7-47d1-89c7-b8026fdbaedd None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.194539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb87b-33e7-47d1-89c7-b8026fdbaedd None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.194820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb87b-33e7-47d1-89c7-b8026fdbaedd None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.201596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 403/835] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:35.201596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bb87b-33e7-47d1-89c7-b8026fdbaedd None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.224949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304463b3-f133-4bba-b918-ffeb1219de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:35.225608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304463b3-f133-4bba-b918-ffeb1219de69 None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.225886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304463b3-f133-4bba-b918-ffeb1219de69 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.226157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304463b3-f133-4bba-b918-ffeb1219de69 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/09dd7aa113ee4a83b06726b37b522eaa/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.241958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304463b3-f133-4bba-b918-ffeb1219de69 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=09dd7aa113ee4a83b06726b37b522eaa, role_id=e5343d2ac4f74aa0ab98b62ee8a0c6dd)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:35.243392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304463b3-f133-4bba-b918-ffeb1219de69 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:35.245731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:35.259640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 433/836] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:35 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/09dd7aa113ee4a83b06726b37b522eaa/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:12:35.261398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdf078-1c32-413b-a525-7f8146dfdaaf None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.261680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdf078-1c32-413b-a525-7f8146dfdaaf None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.261990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdf078-1c32-413b-a525-7f8146dfdaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.285915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-77cdf078-1c32-413b-a525-7f8146dfdaaf None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:35.287357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-77cdf078-1c32-413b-a525-7f8146dfdaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:35.336512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bb87b-33e7-47d1-89c7-b8026fdbaedd None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:35.387987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 434/837] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:35.405270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:35.406230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.406785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.407199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.408109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:35.408557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:35.410240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:35.420873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 404/838] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:35.432221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdf078-1c32-413b-a525-7f8146dfdaaf None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.549346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdf078-1c32-413b-a525-7f8146dfdaaf None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:35.582669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:35.602824 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:35.603729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.604307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.604964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.629378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:35.631044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:35.650968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:35.652135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:35.653179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:35.653179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:35.653179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:35.654841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 435/839] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:35.660368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.732826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:35.744930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.793523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96debd89-cd18-4e0a-b852-465da1fffa44 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:35.842006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:35.842627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.842917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.843183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.843857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:35.844168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:35.845667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:35.860890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 405/840] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:35.866299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.877181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522672-442d-4c56-8bde-32b9349a8750 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:35.918792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:35.919830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:35.920341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:35.920816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:35.921616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:35.923194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:35.938909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:35.940112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:35.940980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 436/841] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:35.946373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:35.998722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11607-10b9-47ec-b5ab-b08b05736483 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:36.019738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:36.032976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:36.051220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:36.052911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.053428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.053428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.061392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:36.062828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:36.075615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:36.076708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 15:12:36.077682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:36.082801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 406/842] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:12:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:36.083713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:36.087629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb6014-0511-49cc-96f5-4c0dff88b5c0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:36.146074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:36.147797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.148310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.148752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.149861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:36.151101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:36.153455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:36.161258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 437/843] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:36.167589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:36.209801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10bbe9-4563-4bfd-a90d-9a8d16a64382 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:36.252916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:36.253725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.254104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.254500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.255284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:36.255860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:36.257286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:36.285413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 407/844] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Sep 14 15:12:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:36.286591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:36.329712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd3dd-de19-488c-b340-3a5bf75cb641 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:36.335766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:36.341897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:36.386739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173435f3-8970-4ada-b931-51852d192036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:36.388235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173435f3-8970-4ada-b931-51852d192036 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.389198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173435f3-8970-4ada-b931-51852d192036 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.389612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173435f3-8970-4ada-b931-51852d192036 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.390407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173435f3-8970-4ada-b931-51852d192036 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:36.391146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173435f3-8970-4ada-b931-51852d192036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:36.392856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173435f3-8970-4ada-b931-51852d192036 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:36.404292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 438/845] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:36.416499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571354-70c7-4bac-b819-91d933450c7a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:36.458979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f19dd-32b4-4e5c-a6dd-0e0680d4a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:36.460108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f19dd-32b4-4e5c-a6dd-0e0680d4a360 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.460602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f19dd-32b4-4e5c-a6dd-0e0680d4a360 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.461123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f19dd-32b4-4e5c-a6dd-0e0680d4a360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.546936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f19dd-32b4-4e5c-a6dd-0e0680d4a360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:36.548808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f19dd-32b4-4e5c-a6dd-0e0680d4a360 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:36.601316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:36.672160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 408/846] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:12:36.677786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173435f3-8970-4ada-b931-51852d192036 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:36.798163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173435f3-8970-4ada-b931-51852d192036 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:36.836483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:36.837128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.837411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.837687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.850475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:36.851962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:36.863335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a4be-a076-4b1b-b895-3e86abc86b95 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.863617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a4be-a076-4b1b-b895-3e86abc86b95 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.863910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a4be-a076-4b1b-b895-3e86abc86b95 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.865515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 409/847] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:36.868526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:36.869982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:36.870876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:36.870876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:36.870876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:36.870876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 439/848] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:36.871514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b02d-b7f3-42cc-8109-2858d92ab739 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:36.871514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b02d-b7f3-42cc-8109-2858d92ab739 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:36.871751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b02d-b7f3-42cc-8109-2858d92ab739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:36.877386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:36.891109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-df29b02d-b7f3-42cc-8109-2858d92ab739 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:36.892451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-df29b02d-b7f3-42cc-8109-2858d92ab739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:36.908234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:36.970579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 410/849] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:37.003136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bc049-cccf-40a4-88f5-9f37bfd24580 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:37.039154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:37.040022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.040465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.040889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.041702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:37.042151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:37.043685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:37.058618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 440/850] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:37.064303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b02d-b7f3-42cc-8109-2858d92ab739 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:37.134674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:37.171376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b02d-b7f3-42cc-8109-2858d92ab739 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:37.211955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:37.213311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.213733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.214169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.221487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:37.223077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:37.235466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:37.236599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:37.237742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:37.239289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:37.241335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 411/851] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:37.258837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:37.336680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:37.358580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b83ac-98a9-448e-b635-975fc52e7bec None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:37.388859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b774f-6e1a-40f5-84c7-69566e7e7153 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:37.397530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:37.398804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.399281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.399744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.401029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:37.402580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:37.412101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:37.413042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:37.413933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:37.417158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 441/852] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Sep 14 15:12:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:37.422572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:37.426367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:37.435622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:37.436282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.436556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.436822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.437571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:37.437867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:37.439394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:37.452451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 412/853] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:37.458041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:37.554832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8a2f-02fc-43fb-978c-14fc17ed3b3a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:37.591894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287fe6b-0dee-4ae5-b8be-1c0a23079cb9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:37.594344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:37.595011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.595382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.595643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.597057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:37.597057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:37.598276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:37.609008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 442/854] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:37.613430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:37.632339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:37.644758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc20fe0-38f2-4c7a-befc-a4a87b788250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:37.645715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20fe0-38f2-4c7a-befc-a4a87b788250 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.646193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20fe0-38f2-4c7a-befc-a4a87b788250 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.646700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20fe0-38f2-4c7a-befc-a4a87b788250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.647625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc20fe0-38f2-4c7a-befc-a4a87b788250 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=59d8c0a83f53476abaac005263ac3bd0) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:37.648178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc20fe0-38f2-4c7a-befc-a4a87b788250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:37.649881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc20fe0-38f2-4c7a-befc-a4a87b788250 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:37.657834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 413/855] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:37 2022] GET /identity/v3/role_assignments?user.id=59d8c0a83f53476abaac005263ac3bd0&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:37.691097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4488b-6127-47b7-8c9e-77ba5963e7cb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.691426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4488b-6127-47b7-8c9e-77ba5963e7cb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.691645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4488b-6127-47b7-8c9e-77ba5963e7cb None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.693375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 414/856] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:37.699546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1393183-60a8-4158-9836-ec03ca819847 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.700269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1393183-60a8-4158-9836-ec03ca819847 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.700749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1393183-60a8-4158-9836-ec03ca819847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.721532 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c1393183-60a8-4158-9836-ec03ca819847 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:37.723182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c1393183-60a8-4158-9836-ec03ca819847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:37.750626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f28f8-b7c7-4948-980f-5e7c95d044fe None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:37.780444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:37.790264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:37.790892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:37.791729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:37.792030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:37.792792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:37.792980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:37.794392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:37.807858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 443/857] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:37.817606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 415/858] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:38.090302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:38.165743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:38.199479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f57d-50b4-47e4-97fc-7ef5fefbe547 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:38.235205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:38.235846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:38.236127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:38.236397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:38.247376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:38.252656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:38.253590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:38.254419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 444/859] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:12:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:38.261975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1393183-60a8-4158-9836-ec03ca819847 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:38.369877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1393183-60a8-4158-9836-ec03ca819847 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:38.407643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:38.408832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:38.409454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:38.409955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:38.410835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:38.411344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:38.412950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:38.422488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 416/860] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:12:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:38.428516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:38.542904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305af81-32ac-41aa-87d9-3559af919c84 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:38.578414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:38.584995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e27a3-1760-4f9b-b0e7-7b478ba44359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:38.585831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e27a3-1760-4f9b-b0e7-7b478ba44359 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:38.586315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e27a3-1760-4f9b-b0e7-7b478ba44359 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:38.586762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e27a3-1760-4f9b-b0e7-7b478ba44359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:38.599763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e27a3-1760-4f9b-b0e7-7b478ba44359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:38.601240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e27a3-1760-4f9b-b0e7-7b478ba44359 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-043e27a3-1760-4f9b-b0e7-7b478ba44359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:38.617462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:38.618458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:38.619494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:38.619494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:38.619494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:38.619494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 445/861] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:38.626480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:38.676889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:38.683980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265e915-daf2-4ed2-96ec-ae5b78dac818 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:38.684264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265e915-daf2-4ed2-96ec-ae5b78dac818 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:38.684537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265e915-daf2-4ed2-96ec-ae5b78dac818 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:38.687196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 446/862] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:38.691321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458e27-894e-42ec-bdd0-f4b71b789cc7 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:38.691597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458e27-894e-42ec-bdd0-f4b71b789cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:38.691934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458e27-894e-42ec-bdd0-f4b71b789cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:38.710951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-bc458e27-894e-42ec-bdd0-f4b71b789cc7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:38.712247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-bc458e27-894e-42ec-bdd0-f4b71b789cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:38.738816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db26c26-d7e4-408c-9e29-829a329c0c23 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:38.778202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:38.779187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:38.779672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:38.780214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:38.781007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:38.781475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:38.782979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:38.795896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 447/863] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:38.801635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 417/864] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:38.807365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc458e27-894e-42ec-bdd0-f4b71b789cc7 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:38.913574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc458e27-894e-42ec-bdd0-f4b71b789cc7 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:38.928024 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:38.953985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:38.954612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:38.954884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:38.955144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:38.962593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:38.964699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:38.976579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:38.977577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:38.978940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 448/865] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:12:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:38.983382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:39.071770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:39.091326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae3ff8-002a-49d9-8ae3-1dbf49e18bd6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:39.093857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:39.129815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:39.130424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:39.130699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:39.130966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:39.131828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:39.132149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:39.133696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:39.153664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 418/866] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Sep 14 15:12:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:39.159588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:39.191104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb59d0-5ac5-41b2-8699-734b5872db57 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:39.228988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:39.229988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:39.230444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:39.230886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:39.231712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:39.233284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:39.253907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 449/867] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:12:39 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:39.293093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ea4f4-2836-4e33-8a95-9d583b94a8eb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:39.343394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:39.344048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:39.344327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:39.344599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:39.376676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:39.425412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:39.426895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:39.542270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 419/868] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:39 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 15:12:39.547558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:39.587245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:39.660495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0029b3-ab4a-45ab-91ae-d79bad326532 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:39.699287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:39.699949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:39.700228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:39.700473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:39.712316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:39.713857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:39.729293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:39.730283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:39.731180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:39.731180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:39.731180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:39.731180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 450/869] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:39.737568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:39.800568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:39.847727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f371d-9a55-43f7-8a04-8981cbc104ef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:39.887211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c65e-72be-424e-b0cc-925f9d882df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:39.888219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c65e-72be-424e-b0cc-925f9d882df6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:39.888709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c65e-72be-424e-b0cc-925f9d882df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:39.889181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c65e-72be-424e-b0cc-925f9d882df6 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:39.890054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c65e-72be-424e-b0cc-925f9d882df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:39.890560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c65e-72be-424e-b0cc-925f9d882df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:39.892153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c65e-72be-424e-b0cc-925f9d882df6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:39.905651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 420/870] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:39.911450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:39.970471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d692-c735-4fd7-adae-c4346127fa69 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:39.970810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d692-c735-4fd7-adae-c4346127fa69 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:39.971030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d692-c735-4fd7-adae-c4346127fa69 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:39.972762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 421/871] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:39.977905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f231c3-e581-4001-8e77-47b3aed75a66 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:39.978187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f231c3-e581-4001-8e77-47b3aed75a66 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:39.978519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f231c3-e581-4001-8e77-47b3aed75a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:39.998303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-13f231c3-e581-4001-8e77-47b3aed75a66 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:39.999536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-13f231c3-e581-4001-8e77-47b3aed75a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:40.016073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:40.035057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d3a39-5739-4a44-bead-a257bb85b68b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:40.086655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:40.088700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.089430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.090076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.096628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 422/872] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:40.104989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:40.106856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:40.124415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:40.125836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:40.126794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:40.128941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 451/873] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:40.129968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0ca19-2273-4ab5-ad39-379cd12d0c59 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.130327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0ca19-2273-4ab5-ad39-379cd12d0c59 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.130666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0ca19-2273-4ab5-ad39-379cd12d0c59 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.135867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 423/874] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:40.137017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:40.138809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7de6a-54aa-4ac5-b8c1-e499c50cde92 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.139090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7de6a-54aa-4ac5-b8c1-e499c50cde92 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.139362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7de6a-54aa-4ac5-b8c1-e499c50cde92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.159499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-09c7de6a-54aa-4ac5-b8c1-e499c50cde92 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:40.160854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-09c7de6a-54aa-4ac5-b8c1-e499c50cde92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:40.217590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:40.255836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 424/875] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:40.264300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75908c6-87d4-4304-93a0-a272d72cfbf6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:40.302974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:40.303584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.303889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.304169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.304862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:40.305166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:40.306674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:40.319774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 452/876] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:40.328953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7de6a-54aa-4ac5-b8c1-e499c50cde92 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:40.397115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:40.411737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:40.436386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7de6a-54aa-4ac5-b8c1-e499c50cde92 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:40.474205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:40.474870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.475149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.475421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.476184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=09dd7aa113ee4a83b06726b37b522eaa) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:40.476512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:40.477919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:40.484725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 425/877] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:40 2022] GET /identity/v3/role_assignments?user.id=09dd7aa113ee4a83b06726b37b522eaa&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:40.534046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c147b7-895a-4cb1-8014-a83c932cd643 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:40.542371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:40.579190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:40.580626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.581130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.581736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.582665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:40.584369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:40.595686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:40.596914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:40.597836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:40.600118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 453/878] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:40.607262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:40.608196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:40.696555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f051a1-6723-41cc-a115-5b57a03547c1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:40.702071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:40.741879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:40.742784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.743063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.743338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.743921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f656b-213c-4009-a799-aef9471f3377 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:40.744573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:40.746840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:40.769729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 426/879] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:12:40 2022] POST /identity/v3/services => generated 269 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:12:40.799433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c56b5a-7aad-49c2-93e7-d87795863c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:40.800106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c56b5a-7aad-49c2-93e7-d87795863c1c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.800378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c56b5a-7aad-49c2-93e7-d87795863c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.800643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c56b5a-7aad-49c2-93e7-d87795863c1c None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.801366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c56b5a-7aad-49c2-93e7-d87795863c1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:40.801664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c56b5a-7aad-49c2-93e7-d87795863c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:40.803050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c56b5a-7aad-49c2-93e7-d87795863c1c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:40.809635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 454/880] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:40.815069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:40.945366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671c325-f14a-46f0-befa-9bc693eb61ee None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:40.948418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:40.987993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58babe54-de9b-4d0d-a3d4-59485eacef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:40.988876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58babe54-de9b-4d0d-a3d4-59485eacef49 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:40.989312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58babe54-de9b-4d0d-a3d4-59485eacef49 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:40.989755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58babe54-de9b-4d0d-a3d4-59485eacef49 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:40.990402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58babe54-de9b-4d0d-a3d4-59485eacef49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:40.990710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58babe54-de9b-4d0d-a3d4-59485eacef49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:40.992128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58babe54-de9b-4d0d-a3d4-59485eacef49 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:40.999339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 427/881] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:41.584098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7581807-959f-4c3f-905a-a4ad8dbff209 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:41.584648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7581807-959f-4c3f-905a-a4ad8dbff209 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:41.584648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7581807-959f-4c3f-905a-a4ad8dbff209 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:41.586106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 455/882] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:41.591571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41bc43-f27f-4931-a6a6-aa7031111ba5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:41.592408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41bc43-f27f-4931-a6a6-aa7031111ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:41.592888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41bc43-f27f-4931-a6a6-aa7031111ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:41.616033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-4b41bc43-f27f-4931-a6a6-aa7031111ba5 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:41.617560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4b41bc43-f27f-4931-a6a6-aa7031111ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:41.692937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 428/883] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:41.957870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7581807-959f-4c3f-905a-a4ad8dbff209 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:42.074653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7581807-959f-4c3f-905a-a4ad8dbff209 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:42.111862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:42.118890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:42.120131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:42.120411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:42.120681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:42.121311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:42.122692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:42.132118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:42.133145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:42.133974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 456/884] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:42.141892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41bc43-f27f-4931-a6a6-aa7031111ba5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:42.238275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:42.244881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41bc43-f27f-4931-a6a6-aa7031111ba5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:42.281813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:42.282421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:42.282695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:42.282961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:42.283596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:42.283998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:42.285362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:42.290933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 429/885] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:42.296627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:42.401840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a38cc-24e7-4083-9567-ef0a80aeb094 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:42.437086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:42.437740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:42.438015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:42.438284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:42.438941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:42.439236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:42.440672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:42.445848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 457/886] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:42.452300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:42.559364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a14545-d3b6-4efc-80f5-c16d96688c20 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:42.594836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601552e-4237-4151-be83-76f6ba4f3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:42.595498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601552e-4237-4151-be83-76f6ba4f3456 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:42.595737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601552e-4237-4151-be83-76f6ba4f3456 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:42.596017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601552e-4237-4151-be83-76f6ba4f3456 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:42.596731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601552e-4237-4151-be83-76f6ba4f3456 None admin] RBAC: Adding query filter params (interface=public, service_id=bce74313418b4d87960549698788aaf5, region_id=RegionOne) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:42.597098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601552e-4237-4151-be83-76f6ba4f3456 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:42.598482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601552e-4237-4151-be83-76f6ba4f3456 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:42.607290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 430/887] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:12:42 2022] GET /identity/v3/endpoints?service_id=bce74313418b4d87960549698788aaf5&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:42.616192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:42.679756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:42.723078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee5885-3589-458f-ad11-540f698f0839 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:42.764156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0bca-4311-4586-9494-e01f528a5a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:42.764775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0bca-4311-4586-9494-e01f528a5a91 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:42.765049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0bca-4311-4586-9494-e01f528a5a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:42.765316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0bca-4311-4586-9494-e01f528a5a91 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:42.765927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0bca-4311-4586-9494-e01f528a5a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:42.767289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0bca-4311-4586-9494-e01f528a5a91 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:42.773848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 458/888] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:12:42 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:12:42.858595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b06f-00e0-421d-893a-7a4402a6b147 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:42.858786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b06f-00e0-421d-893a-7a4402a6b147 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:42.859048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b06f-00e0-421d-893a-7a4402a6b147 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:42.860797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 431/889] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:42.866528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328046d-06d2-477b-b4ad-fe2a032df0c1 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:42.866832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328046d-06d2-477b-b4ad-fe2a032df0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:42.867072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328046d-06d2-477b-b4ad-fe2a032df0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:42.886946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-5328046d-06d2-477b-b4ad-fe2a032df0c1 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:42.888192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5328046d-06d2-477b-b4ad-fe2a032df0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:42.965652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 459/890] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:43.140902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5ebbc-1ba9-4766-957a-bc803bf9dd46 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.141256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5ebbc-1ba9-4766-957a-bc803bf9dd46 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.141439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5ebbc-1ba9-4766-957a-bc803bf9dd46 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.143032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 432/891] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:43.148387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22b86-7c13-418d-8232-a365b8f5b3b0 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.148669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22b86-7c13-418d-8232-a365b8f5b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.148942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22b86-7c13-418d-8232-a365b8f5b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.170339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-3ca22b86-7c13-418d-8232-a365b8f5b3b0 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:43.171637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-3ca22b86-7c13-418d-8232-a365b8f5b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:43.222300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:43.242739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 460/892] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:43.248587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5ebbc-1ba9-4766-957a-bc803bf9dd46 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:43.277484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:43.290709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879ff3-1389-4b01-a91d-d17270089c44 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.292813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879ff3-1389-4b01-a91d-d17270089c44 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.292813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879ff3-1389-4b01-a91d-d17270089c44 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.292813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 461/893] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:43.301501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791f93-303f-4afa-babd-c8899697a428 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.301783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791f93-303f-4afa-babd-c8899697a428 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.302038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791f93-303f-4afa-babd-c8899697a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.322645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-a6791f93-303f-4afa-babd-c8899697a428 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:43.324174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-a6791f93-303f-4afa-babd-c8899697a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:43.369086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5ebbc-1ba9-4766-957a-bc803bf9dd46 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:43.404073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 462/894] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:43.409439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:43.410084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.410364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.410681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.423127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:43.428193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:43.429137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:43.429988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 433/895] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Sep 14 15:12:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:43.440881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791f93-303f-4afa-babd-c8899697a428 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:43.524790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:43.553789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791f93-303f-4afa-babd-c8899697a428 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:43.571149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:43.601161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:43.602072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.602346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.602613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.603308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:43.603609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:43.605184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:43.615831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 463/896] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Sep 14 15:12:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:43.621669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:43.644188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:43.671117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19daa24-546c-4c6d-bb7f-5690e08aa27e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:43.709763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:43.709970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.710081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.710359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.710943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:43.712349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:43.724211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:43.725238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:43.726174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 434/897] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Sep 14 15:12:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:43.726979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:43.752628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863987e-15f5-4df3-a5ce-1f28d6fc1041 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:43.788917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:43.789544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.789823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.790095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.801295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:43.802734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:43.817179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:43.818355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:43.819433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:43.819433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:43.819433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:43.823068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 464/898] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:43.823777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:43.846555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f898df-cd6e-4fab-a3aa-5b4ca200a840 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:43.855844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:43.884535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:43.885127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:43.885399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:43.885682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:43.886313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:43.887672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:43.906218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 435/899] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:12:43 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:43.907071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:43.927855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:43.954199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bceb-2946-4029-8f87-5937e8e072e3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.005013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.006098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.006695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.007187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.008214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:44.008715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.010958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.017165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 465/900] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:44.026141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:44.055045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64962c-d86d-40f9-8639-332c2e4ce715 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.095741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.096404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.096687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.096961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.098079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:44.098401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.100149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.118346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 436/901] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:44.119452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:44.142624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:44.159927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cdf8b-9b73-4f70-b2c0-9412142c0623 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.203277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.203830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.204127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.204398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.205031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:44.205334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.206686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.212339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:44.219079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 466/902] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:44.226059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:44.249895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51294933-5867-4323-a612-7cacb87ebcef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.288889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.289834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.290136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.290508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.298819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.300721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:44.313836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:44.315079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:44.316304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:44.322654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 437/903] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:12:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:44.324852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:44.351498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505ae1f-0fc4-4a8f-b1a7-dee77293b465 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.403217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.403846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.404120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.404386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.405087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] RBAC: Adding query filter params (interface=public, service_id=0f982de618f64dac9469f04ffacc5886, region_id=RegionOne) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:44.405390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.406759 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.417020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 467/904] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:12:44 2022] GET /identity/v3/endpoints?service_id=0f982de618f64dac9469f04ffacc5886&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:44.418202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:44.436639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:44.474958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ed540-c481-442b-9f5c-4f20ea9cac3e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.511698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:44.523073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.524272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.524552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.524821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.525945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:44.526245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.527707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.539346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857ef4-fd1e-4789-a180-100d4e28b791 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.559825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 438/905] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Sep 14 15:12:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:44.561354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:44.582756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.583104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.583359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.583628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.584362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.585784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.599875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 468/906] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:12:44 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:12:44.692690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ceab1-09b4-4f11-9cc3-1cfcaf9c5025 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:44.732054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4071e4-d9b8-4af7-9ffd-e54d91431688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:44.732910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4071e4-d9b8-4af7-9ffd-e54d91431688 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:44.733337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4071e4-d9b8-4af7-9ffd-e54d91431688 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:44.733753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4071e4-d9b8-4af7-9ffd-e54d91431688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:44.796049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:44.811945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4071e4-d9b8-4af7-9ffd-e54d91431688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:44.813506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4071e4-d9b8-4af7-9ffd-e54d91431688 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:44.925938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 439/907] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:44 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:12:44.932734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.016718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:45.039525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199c82-b130-4ce0-906e-a33b0b04b741 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.039902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199c82-b130-4ce0-906e-a33b0b04b741 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.040115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199c82-b130-4ce0-906e-a33b0b04b741 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.041768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d216-a80f-4ea5-bb30-a95096c6bd72 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.042282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 440/908] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:45.047436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4b7c-a398-41f0-8e0a-8fb8491f3338 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.047706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4b7c-a398-41f0-8e0a-8fb8491f3338 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.048018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4b7c-a398-41f0-8e0a-8fb8491f3338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.066744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-436f4b7c-a398-41f0-8e0a-8fb8491f3338 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:45.067701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-436f4b7c-a398-41f0-8e0a-8fb8491f3338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:45.084319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.085533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.086010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.086476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.101655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.104927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:45.123534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:45.124558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:45.125452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:45.125452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:45.125452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:45.132140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 469/909] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:45.133865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.147569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 441/910] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:45.242119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228755a-57b4-4870-b223-e090aa841a24 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.271646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:45.278516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.279124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.279398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.279642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.280309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:45.280607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.281944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.301673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 470/911] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:45.307334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f4b7c-a398-41f0-8e0a-8fb8491f3338 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.327123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:45.413016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f4b7c-a398-41f0-8e0a-8fb8491f3338 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.437696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.449295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.449927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.450612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.450612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.458094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.459657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:45.472411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:45.473368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:45.474278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 442/912] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:45.480192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.553247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b6f62-acc9-4501-992b-b5513df87117 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.563988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:45.591161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afb9e-8bd7-4f2e-a5c8-ee6099953d7c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.598173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a33980-f761-4802-a701-31288b1269cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.599178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a33980-f761-4802-a701-31288b1269cc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.599659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a33980-f761-4802-a701-31288b1269cc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.600153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a33980-f761-4802-a701-31288b1269cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.601709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a33980-f761-4802-a701-31288b1269cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.603375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a33980-f761-4802-a701-31288b1269cc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-31a33980-f761-4802-a701-31288b1269cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:45.613920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:45.614951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:12:45.615784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:45.623383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 471/913] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:45.625259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a33980-f761-4802-a701-31288b1269cc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.627054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.627731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.628122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.628457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.629382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:45.629767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.631372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.650967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 443/914] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:45.652106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.690923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:45.744035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a33980-f761-4802-a701-31288b1269cc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.762891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f103-09c1-4c32-9b2c-458a1ebc33c7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.787436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.788497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.788959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.789485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.790326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:45.790879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.792718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.803442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 472/915] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:45.804610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:45.806685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.807298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.807569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.807860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.808713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] RBAC: Adding query filter params (role.id=fc3f67737c7f4cdfb5276cba7df80d15, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=09dd7aa113ee4a83b06726b37b522eaa) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:45.809017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.810594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.813732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:45.822501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 444/916] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:45 2022] GET /identity/v3/role_assignments?user.id=09dd7aa113ee4a83b06726b37b522eaa&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=fc3f67737c7f4cdfb5276cba7df80d15 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:45.932600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc22ba-380d-4b33-8a17-d1e510086772 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:45.953224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:45.974788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96544a45-5f96-4b40-8ce0-8da95b29ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:45.975894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544a45-5f96-4b40-8ce0-8da95b29ab63 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:45.976460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544a45-5f96-4b40-8ce0-8da95b29ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:45.976951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544a45-5f96-4b40-8ce0-8da95b29ab63 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:45.977818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96544a45-5f96-4b40-8ce0-8da95b29ab63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:45.978385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96544a45-5f96-4b40-8ce0-8da95b29ab63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:45.980049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96544a45-5f96-4b40-8ce0-8da95b29ab63 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:45.986549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 473/917] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Sep 14 15:12:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:45.992693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:46.103744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2246b-080b-4d93-9f2c-015481decedc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:46.142619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aed92-6406-40e8-9c62-aba7b1ed68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:46.143581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aed92-6406-40e8-9c62-aba7b1ed68a8 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:46.144127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aed92-6406-40e8-9c62-aba7b1ed68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:46.144626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aed92-6406-40e8-9c62-aba7b1ed68a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:46.145572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aed92-6406-40e8-9c62-aba7b1ed68a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:46.147165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aed92-6406-40e8-9c62-aba7b1ed68a8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:46.170807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 445/918] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:12:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:46.218286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459eec-0514-405f-be97-2ebfc442add2 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:46.218937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459eec-0514-405f-be97-2ebfc442add2 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:46.219417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459eec-0514-405f-be97-2ebfc442add2 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:46.221320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 474/919] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:46.226638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744080b-28b5-4bd0-bf53-b78187f73eeb None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:46.226977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744080b-28b5-4bd0-bf53-b78187f73eeb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:46.227265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744080b-28b5-4bd0-bf53-b78187f73eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:46.248937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c744080b-28b5-4bd0-bf53-b78187f73eeb None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:46.250168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c744080b-28b5-4bd0-bf53-b78187f73eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:46.315115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:46.341963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 446/920] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:46.609515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459eec-0514-405f-be97-2ebfc442add2 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:46.715070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459eec-0514-405f-be97-2ebfc442add2 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:46.752868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4ef0a-2556-4acb-a6d4-2f437867e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:46.753862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ef0a-2556-4acb-a6d4-2f437867e19d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:46.754352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ef0a-2556-4acb-a6d4-2f437867e19d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:46.754873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ef0a-2556-4acb-a6d4-2f437867e19d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:46.755710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4ef0a-2556-4acb-a6d4-2f437867e19d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:46.757359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4ef0a-2556-4acb-a6d4-2f437867e19d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-2fb4ef0a-2556-4acb-a6d4-2f437867e19d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:46.766909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:46.767957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:46.768830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:46.771588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 475/921] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:46.778704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744080b-28b5-4bd0-bf53-b78187f73eeb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:46.887058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744080b-28b5-4bd0-bf53-b78187f73eeb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:46.912350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668dba-0c17-4459-9504-5670d110e2c7 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:46.912671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668dba-0c17-4459-9504-5670d110e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:46.912938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668dba-0c17-4459-9504-5670d110e2c7 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:46.915621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 476/922] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:46.920350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8196e-39e4-4b3c-a996-ccb416498004 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:46.920639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8196e-39e4-4b3c-a996-ccb416498004 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:46.920894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8196e-39e4-4b3c-a996-ccb416498004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:46.926695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:46.927447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:46.927748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:46.928134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:46.928786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:46.929089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:46.930444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:46.935684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 447/923] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:46.940234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9fb8196e-39e4-4b3c-a996-ccb416498004 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:46.941641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9fb8196e-39e4-4b3c-a996-ccb416498004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:46.944774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:46.994602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:47.005786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:47.023344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 477/924] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:47.072588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614da4-a9e2-4198-879f-2d0abf40f874 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:47.112762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:47.113675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:47.114126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:47.114592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:47.115659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:47.116155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:47.117891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:47.123704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 448/925] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:47.132223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8196e-39e4-4b3c-a996-ccb416498004 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:47.242334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8196e-39e4-4b3c-a996-ccb416498004 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:47.279616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:47.280562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:47.281024 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:47.281498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:47.282388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] RBAC: Adding query filter params (interface=public, service_id=0a343dc70c2e46e28689538ae9e13fe0, region_id=RegionOne) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:47.282877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:47.284438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:47.290635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 478/926] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:12:47 2022] GET /identity/v3/endpoints?service_id=0a343dc70c2e46e28689538ae9e13fe0&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:47.296668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:47.329869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:47.378443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:47.422506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69bd8-6e2b-453e-a6c1-0d4b0dd48096 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:47.444269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:47.454314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdb473-300c-4930-b8f6-930f88791f05 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:47.470173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:47.471507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:47.472241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:47.472724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:47.473769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:47.475740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:47.492596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 449/927] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:12:47 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:12:47.502228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:47.502897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:47.503176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:47.503449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:47.504082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:47.505566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:47.516507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:47.517536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:12:47.518444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:47.522940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 479/928] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Sep 14 15:12:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:47.524600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:47.660504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4268cba-7fee-4a5f-8ccd-3df3ba6dd639 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:47.699308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:47.700021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:47.700330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:47.700800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:47.701911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:47.702315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:47.704561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:47.710957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 450/929] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:47.716750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:47.827429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea9a2-fb25-42fe-aa17-9c6236e96bb2 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:47.830174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:47.863309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4fdbb-555d-4f26-8a35-c7a2fd14ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:47.863940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fdbb-555d-4f26-8a35-c7a2fd14ce80 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:47.864221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fdbb-555d-4f26-8a35-c7a2fd14ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:47.864494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fdbb-555d-4f26-8a35-c7a2fd14ce80 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:47.865129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4fdbb-555d-4f26-8a35-c7a2fd14ce80 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:47.865432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4fdbb-555d-4f26-8a35-c7a2fd14ce80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:47.866806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4fdbb-555d-4f26-8a35-c7a2fd14ce80 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:47.872975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 480/930] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:47.878999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:47.925768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:47.991475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5519fb-bd60-4a21-a3aa-e5c0ad868ff8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:48.032283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc46a36-9611-44c5-ac66-4c239838d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:48.033335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46a36-9611-44c5-ac66-4c239838d77b None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:48.033818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46a36-9611-44c5-ac66-4c239838d77b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:48.034293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46a36-9611-44c5-ac66-4c239838d77b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:48.035195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc46a36-9611-44c5-ac66-4c239838d77b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:48.036857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc46a36-9611-44c5-ac66-4c239838d77b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:48.061341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 451/931] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:12:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:48.132253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f115f5-1f7f-48bf-a4d3-6b0b9ae732fe None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:48.132767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f115f5-1f7f-48bf-a4d3-6b0b9ae732fe None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:48.132767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f115f5-1f7f-48bf-a4d3-6b0b9ae732fe None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:48.134333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 481/932] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:48.139984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060c9b-3a82-4fad-bf07-4dc441c57094 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:48.140305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060c9b-3a82-4fad-bf07-4dc441c57094 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:48.140539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060c9b-3a82-4fad-bf07-4dc441c57094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:48.161889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-26060c9b-3a82-4fad-bf07-4dc441c57094 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:48.163114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-26060c9b-3a82-4fad-bf07-4dc441c57094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:48.247746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 452/933] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:48.482901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d5768-394f-4b7c-a299-e077d4665ee4 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:48.483258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d5768-394f-4b7c-a299-e077d4665ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:48.483446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d5768-394f-4b7c-a299-e077d4665ee4 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:48.485097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 482/934] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:48.490606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05893c-600f-49b6-ba99-a9d52a72b615 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:48.490889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05893c-600f-49b6-ba99-a9d52a72b615 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:48.491151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05893c-600f-49b6-ba99-a9d52a72b615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:48.510536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fa05893c-600f-49b6-ba99-a9d52a72b615 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:48.511761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fa05893c-600f-49b6-ba99-a9d52a72b615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:48.521572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d5768-394f-4b7c-a299-e077d4665ee4 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:48.531049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:48.598613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 453/935] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:48.651039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d5768-394f-4b7c-a299-e077d4665ee4 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:48.686191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:48.686895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:48.687169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:48.687435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:48.699335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:48.704288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:48.705246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:48.706489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 483/936] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Sep 14 15:12:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:48.713470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05893c-600f-49b6-ba99-a9d52a72b615 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:48.830463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05893c-600f-49b6-ba99-a9d52a72b615 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:48.877885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:48.878121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:48.879130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:48.880028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:48.880518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:48.881414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:48.881928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:48.883520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:48.894069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 454/937] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Sep 14 15:12:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:48.901218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:48.916105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:48.921081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:49.012544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661b458-0623-4a5f-bdf2-be1e6496958e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.030338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597a593-e938-447a-95fb-a36bf8d59c5b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.053307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.054230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.054518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.054809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.055551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.057756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.062334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING keystone.server.flask.common [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 15:12:49.085049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.sql.core [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 15:12:49.085049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 15:12:49.085049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [parameters: {'id': '59c623616b854d61bc7f14ee1e019dc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 15:12:49.085049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 15:12:49.089252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.090281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.090781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.091245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59c623616b854d61bc7f14ee1e019dc3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59c623616b854d61bc7f14ee1e019dc3. Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:12:49.093598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result.read() Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 14 15:12:49.094402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application yield resource Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise self.value Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application session.commit() Sep 14 15:12:49.095620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.session.flush() Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application compat.raise_( Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 15:12:49.096986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 15:12:49.097929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result.read() Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:12:49.098718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [parameters: {'id': '59c623616b854d61bc7f14ee1e019dc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.099583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:49.100431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59c623616b854d61bc7f14ee1e019dc3. Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.101350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 484/938] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Sep 14 15:12:48 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:49.105341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:49.125189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.127424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:49.155566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:49.156672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:49.158199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:49.158199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:49.158199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:49.158199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 455/939] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:49.162325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:49.227854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:49.250360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:49.250838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d820-69b4-410d-a1c7-bdc06f683fb0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.295243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.296289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.296810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.297557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.301785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7604-ec93-46c1-8a34-8444a6905c2c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.306299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.308715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:49.323714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:49.324672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:49.326058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:49.329114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 485/940] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:49.335873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:49.345602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.346223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.346498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.346766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.347411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:49.347797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.349789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.367559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 456/941] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:49.373109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:49.469478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85088-9a1c-4e21-b0d7-0b3db63f7080 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.513002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.513612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.513938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.514158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.514830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:49.515132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.515695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67afa5-3abb-4819-b804-496c03bdd044 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.516585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.541886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:49.544542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 486/942] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:49.555545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.556665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.557153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.557658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.566965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.568938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:49.584435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:49.585513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:49.586583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:49.590029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 457/943] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:12:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:49.600783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:49.610758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:49.725450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d224d-4982-45ec-8c05-e182520c0364 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.765112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180529e6-e99b-4872-9980-2f5b20134f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.765726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180529e6-e99b-4872-9980-2f5b20134f79 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.766005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180529e6-e99b-4872-9980-2f5b20134f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.766276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180529e6-e99b-4872-9980-2f5b20134f79 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.767017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180529e6-e99b-4872-9980-2f5b20134f79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:49.767321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180529e6-e99b-4872-9980-2f5b20134f79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.768775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180529e6-e99b-4872-9980-2f5b20134f79 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.788725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 487/944] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Sep 14 15:12:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:49.794730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:49.912065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ca37-73b2-4379-a1e4-9b6fc79fa786 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:49.938470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138e05-7f46-406f-bf6f-4bbee449c5ef None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.938763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138e05-7f46-406f-bf6f-4bbee449c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.939052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138e05-7f46-406f-bf6f-4bbee449c5ef None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.941749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 488/945] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:49.946023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9007d-c336-4f00-96cf-158a34d4f063 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.946305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9007d-c336-4f00-96cf-158a34d4f063 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.946579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9007d-c336-4f00-96cf-158a34d4f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.949224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:49.950138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:49.950653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:49.951085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:49.964023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:49.965843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:49.966542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-c9a9007d-c336-4f00-96cf-158a34d4f063 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:49.968226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-c9a9007d-c336-4f00-96cf-158a34d4f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:49.982256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:49.983478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:49.984552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:49.984552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:49.984552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:49.986269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 458/946] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:49.993797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:50.039301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:50.042691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:50.063975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 489/947] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:50.111692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1b4a8-957b-4cc8-9708-f50a47f2c465 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:50.147267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:50.148152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.148575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.149014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.149804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:50.151062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:50.152647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:50.165815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 459/948] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:50.171610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9007d-c336-4f00-96cf-158a34d4f063 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:50.276832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9007d-c336-4f00-96cf-158a34d4f063 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:50.317818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:50.318703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.319153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.319583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.327678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:50.329303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:50.341840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:50.342960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:50.344099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:50.346447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 490/949] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:50.352396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:50.363630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:50.424652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:50.455770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:50.461954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67ef5-73eb-40e9-bf2e-932386437bbd None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:50.487701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61344be-6834-4d32-98e2-6906a48aefac None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:50.508400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3006d-3872-4773-8fc7-d56f70ef1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:50.510469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3006d-3872-4773-8fc7-d56f70ef1089 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.510984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3006d-3872-4773-8fc7-d56f70ef1089 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.511476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3006d-3872-4773-8fc7-d56f70ef1089 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.512445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3006d-3872-4773-8fc7-d56f70ef1089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:50.513490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3006d-3872-4773-8fc7-d56f70ef1089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:50.516746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3006d-3872-4773-8fc7-d56f70ef1089 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:50.528936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7abde-a9d0-460e-8204-e57f63f7d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:50.529724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7abde-a9d0-460e-8204-e57f63f7d098 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.530002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7abde-a9d0-460e-8204-e57f63f7d098 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.530277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7abde-a9d0-460e-8204-e57f63f7d098 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.530858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7abde-a9d0-460e-8204-e57f63f7d098 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:50.536091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 460/950] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:50.536229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7abde-a9d0-460e-8204-e57f63f7d098 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:50.536310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463aa6-6766-41a5-bfcf-bfc46a42a300 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.536310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463aa6-6766-41a5-bfcf-bfc46a42a300 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.536310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463aa6-6766-41a5-bfcf-bfc46a42a300 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.536310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 461/951] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:50.539433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45463aa6-6766-41a5-bfcf-bfc46a42a300 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-43e7abde-a9d0-460e-8204-e57f63f7d098 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:50.545840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:50.546982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:50.547990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:50.552046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 491/952] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:50.553359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727ba0-4702-4d64-9d79-7de87cebd72a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.553639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727ba0-4702-4d64-9d79-7de87cebd72a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.553907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727ba0-4702-4d64-9d79-7de87cebd72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.575293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-30727ba0-4702-4d64-9d79-7de87cebd72a None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:50.576591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-30727ba0-4702-4d64-9d79-7de87cebd72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:50.652709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 492/953] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:50.653576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727ba0-4702-4d64-9d79-7de87cebd72a None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:50.662389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45463aa6-6766-41a5-bfcf-bfc46a42a300 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:50.704123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:50.704703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.704980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.705250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/09dd7aa113ee4a83b06726b37b522eaa/roles/fc3f67737c7f4cdfb5276cba7df80d15` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.707459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=09dd7aa113ee4a83b06726b37b522eaa, role_id=fc3f67737c7f4cdfb5276cba7df80d15)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:50.708983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:50.711432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:50.725469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 462/954] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:12:50 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/09dd7aa113ee4a83b06726b37b522eaa/roles/fc3f67737c7f4cdfb5276cba7df80d15 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:12:50.771460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727ba0-4702-4d64-9d79-7de87cebd72a None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:50.813135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:50.814075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:50.814522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:50.814935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:50.815751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:50.816226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:50.817764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:50.824241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 493/955] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:50.833516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:50.876201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:50.957452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1296-8e2a-48cb-901c-36755fdeafd2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:50.959933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:51.015361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:51.016073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:51.016287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:51.016546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:51.017178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:51.017473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:51.018839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:51.024457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 463/956] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:51.030164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:51.076510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db0fd5-564a-4f3f-9753-42e908403fe9 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:51.087951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:51.116174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:51.116809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:51.117088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:51.117356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:51.117944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:51.119344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:51.126529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:51.128840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:51.130035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:51.131045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 494/957] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:51.137832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:51.160424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728372f8-c2b0-4985-bd68-49280430b03f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:51.199686 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:51.200762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:51.201263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:51.201766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:51.202688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:51.204368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:51.228703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 464/958] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:12:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:12:51.262630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19819c-94cb-4846-9e70-b3a4c70b2fc6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:51.312605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1e91d-d390-4a0b-9191-90758e2eb8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:51.314017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e91d-d390-4a0b-9191-90758e2eb8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:51.314502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e91d-d390-4a0b-9191-90758e2eb8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:51.314992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e91d-d390-4a0b-9191-90758e2eb8e0 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:51.315871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1e91d-d390-4a0b-9191-90758e2eb8e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:51.316440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1e91d-d390-4a0b-9191-90758e2eb8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:51.318061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1e91d-d390-4a0b-9191-90758e2eb8e0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:51.324514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 495/959] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:51.330782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:51.450716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d06f0-067b-4a97-8755-b5c589ca56ae None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:51.488463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a5cca-b3c9-475a-808a-d654b2614000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:51.488971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a5cca-b3c9-475a-808a-d654b2614000 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:51.489244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a5cca-b3c9-475a-808a-d654b2614000 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:51.489512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a5cca-b3c9-475a-808a-d654b2614000 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:51.490146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a5cca-b3c9-475a-808a-d654b2614000 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:51.490444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a5cca-b3c9-475a-808a-d654b2614000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:51.491849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a5cca-b3c9-475a-808a-d654b2614000 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:51.494163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:51.504027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 465/960] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:51.906065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859270c-65b2-4233-8cc4-8dedbdbe98d4 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:51.906467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859270c-65b2-4233-8cc4-8dedbdbe98d4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:51.906890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859270c-65b2-4233-8cc4-8dedbdbe98d4 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:51.908952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 496/961] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:51.914526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e68e4d-ce18-40fd-986d-3e3dc7f781c7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:51.914811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e68e4d-ce18-40fd-986d-3e3dc7f781c7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:51.915078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e68e4d-ce18-40fd-986d-3e3dc7f781c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:51.933777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f8e68e4d-ce18-40fd-986d-3e3dc7f781c7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:51.934962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f8e68e4d-ce18-40fd-986d-3e3dc7f781c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:52.004130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 466/962] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:52.283334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859270c-65b2-4233-8cc4-8dedbdbe98d4 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:52.322955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:52.391664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859270c-65b2-4233-8cc4-8dedbdbe98d4 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:52.430930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:52.432128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:52.432400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:52.432702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:52.433369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:52.434796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:52.450809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.sql.core [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 15:12:52.450809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 15:12:52.450809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [parameters: {'user_id': 'f43353949fbf43bf9c89b9fb070c6f38', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 15:12:52.450809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result.read() Sep 14 15:12:52.457843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:12:52.458737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application yield resource Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise self.value Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application session.commit() Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 15:12:52.459946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.session.flush() Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application compat.raise_( Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 15:12:52.461178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:12:52.462114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application result.read() Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:12:52.463016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f43353949fbf43bf9c89b9fb070c6f38', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:52.464826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 14 15:12:52.466771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 14 15:12:52.468395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 14 15:12:52.468395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 14 15:12:52.468395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 15:12:52.468395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 15:12:52.468395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 15:12:52.468395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:52.468395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 497/963] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Sep 14 15:12:52 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:52.468889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e68e4d-ce18-40fd-986d-3e3dc7f781c7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:52.575053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e68e4d-ce18-40fd-986d-3e3dc7f781c7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:52.606199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:52.612907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043d65e-4ab2-4cb2-b63d-82c32be40499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:52.613542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043d65e-4ab2-4cb2-b63d-82c32be40499 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:52.613815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043d65e-4ab2-4cb2-b63d-82c32be40499 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:52.614082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043d65e-4ab2-4cb2-b63d-82c32be40499 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:52.621798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043d65e-4ab2-4cb2-b63d-82c32be40499 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:52.623243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043d65e-4ab2-4cb2-b63d-82c32be40499 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2043d65e-4ab2-4cb2-b63d-82c32be40499 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:52.638485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:52.639506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:12:52.640499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:52.643112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 467/964] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:12:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:52.648823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:52.745853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:52.751776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0359-e4bc-4da1-b923-a3b57dee40b1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:52.787644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42919e7e-e041-4e65-8b5e-46d47b75cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:52.788354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42919e7e-e041-4e65-8b5e-46d47b75cf66 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:52.788689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42919e7e-e041-4e65-8b5e-46d47b75cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:52.789021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42919e7e-e041-4e65-8b5e-46d47b75cf66 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:52.789784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42919e7e-e041-4e65-8b5e-46d47b75cf66 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:52.790147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42919e7e-e041-4e65-8b5e-46d47b75cf66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:52.792407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42919e7e-e041-4e65-8b5e-46d47b75cf66 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:52.834655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 498/965] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Sep 14 15:12:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:53.041020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e8e6a-b940-4e04-8f52-456decf27d5d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.041526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e8e6a-b940-4e04-8f52-456decf27d5d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.041632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e8e6a-b940-4e04-8f52-456decf27d5d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.043183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 468/966] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:53.048765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84886-32d3-464c-8b9e-6108e8161edd None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.049054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84886-32d3-464c-8b9e-6108e8161edd None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.049328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84886-32d3-464c-8b9e-6108e8161edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.068943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-16d84886-32d3-464c-8b9e-6108e8161edd None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:53.070852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-16d84886-32d3-464c-8b9e-6108e8161edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:53.144737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 499/967] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:53.417432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e8e6a-b940-4e04-8f52-456decf27d5d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:53.521877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e8e6a-b940-4e04-8f52-456decf27d5d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:53.560555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594bf8-66b3-4d09-9e11-1d541ef81957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:53.561299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594bf8-66b3-4d09-9e11-1d541ef81957 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.561584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594bf8-66b3-4d09-9e11-1d541ef81957 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.561856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594bf8-66b3-4d09-9e11-1d541ef81957 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.573164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c594bf8-66b3-4d09-9e11-1d541ef81957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-3c594bf8-66b3-4d09-9e11-1d541ef81957 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:12:53.577952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:53.578865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:12:53.579741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:53.581038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 469/968] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Sep 14 15:12:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:53.584922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84886-32d3-464c-8b9e-6108e8161edd None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:53.637831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ba88-33f1-4e7e-9f98-2eb92e4beda7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.638297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ba88-33f1-4e7e-9f98-2eb92e4beda7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.638466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ba88-33f1-4e7e-9f98-2eb92e4beda7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.639743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 470/969] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:53.644876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604906-9799-441f-986c-414078583ee7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.645158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604906-9799-441f-986c-414078583ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.645434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604906-9799-441f-986c-414078583ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.664043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-56604906-9799-441f-986c-414078583ee7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:53.665246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-56604906-9799-441f-986c-414078583ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:53.678313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:53.698563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84886-32d3-464c-8b9e-6108e8161edd None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:53.721583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:53.740078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb5809-7f34-445b-9693-c9f715807133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:53.741190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5809-7f34-445b-9693-c9f715807133 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.741655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5809-7f34-445b-9693-c9f715807133 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.742305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5809-7f34-445b-9693-c9f715807133 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.743272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb5809-7f34-445b-9693-c9f715807133 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:53.744340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb5809-7f34-445b-9693-c9f715807133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:53.744675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 471/970] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:53.746197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb5809-7f34-445b-9693-c9f715807133 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:53.755471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 500/971] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Sep 14 15:12:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:53.761008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604906-9799-441f-986c-414078583ee7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:53.809997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e4d0-c3b1-4c17-9071-a79860cd3610 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.810318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e4d0-c3b1-4c17-9071-a79860cd3610 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.810599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e4d0-c3b1-4c17-9071-a79860cd3610 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.812114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 501/972] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:53.816880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49cfe3-32e4-46b8-9e97-84008a9fbdf3 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.817167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49cfe3-32e4-46b8-9e97-84008a9fbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.817446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49cfe3-32e4-46b8-9e97-84008a9fbdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.836215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-ae49cfe3-32e4-46b8-9e97-84008a9fbdf3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:53.837463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ae49cfe3-32e4-46b8-9e97-84008a9fbdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:53.870078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604906-9799-441f-986c-414078583ee7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:53.910702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 502/973] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:53.911417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:53.912154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:53.912432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:53.912698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:53.923857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:53.925297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:53.940597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:53.941560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:53.942465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:53.942465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:53.942465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:53.942465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 472/974] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:53.947217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49cfe3-32e4-46b8-9e97-84008a9fbdf3 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.012972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.030130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.048763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.057217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49cfe3-32e4-46b8-9e97-84008a9fbdf3 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.094849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.095451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.095727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.096022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.096698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:54.097081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.098552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.111881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 503/975] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:54.117291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.120735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860ae5-178d-4db3-81f0-30845a7065d2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.155693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.156352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.156632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.156902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.157484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.158852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:54.168249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:54.169267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:54.170113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 473/976] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:54.175257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.231787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ecb2-2cf4-4316-b29f-670dc198ab93 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.264968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.265592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.265872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.266199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.268957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.269946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.275993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.277394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5b952-e612-48ff-a464-0275564a0f68 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.277549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:12:54.288738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:54.289888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:54.291448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 504/977] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:54.292117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.314073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.314671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.314950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.315217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.315861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:54.316163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.317513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.322212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 474/978] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:54.323003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.395126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8f650-233a-4a7f-92f1-790b80ada83d None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.421506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9722c-e85c-4b9c-a393-7cec3bc2dfed None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.432011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.432618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.432895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.433162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.433813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.435164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.449518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 505/979] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:12:54 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:12:54.450427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.465829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.467137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.467425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.467699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.469050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:54.469371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.471389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.492654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 475/980] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:54.498273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.519107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.532082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.588956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74c53e-1c81-4f36-a514-e1238a8c559f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.623118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a23031-d6d1-4968-a73a-ed4e4f315cb3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.630592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.632538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.632813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.633081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.633719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:54.634023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.635944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.641895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 506/981] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:54.648027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.666758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.667382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.667658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.667983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.739341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.741117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.756989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.761736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a187f6-ce7a-478a-ae5f-9a04b0184896 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.783687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:54.800517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.801124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.801398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.801667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.802375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] RBAC: Adding query filter params (interface=admin, service_id=0a343dc70c2e46e28689538ae9e13fe0, region_id=RegionOne) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:54.802680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.804076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.814175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 507/982] 10.222.0.65 () {56 vars in 1249 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/endpoints?service_id=0a343dc70c2e46e28689538ae9e13fe0&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:54.814877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.853682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 476/983] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:12:54.859642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:54.924224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d132d7-4006-49c8-bacc-7d70c1c5a008 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.961383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:54.962160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:54.962575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:54.962965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:54.963704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:54.965193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:54.971858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 508/984] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:12:54.973633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73f676-af46-4147-8268-b97d6c987f85 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:54.990015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:55.015554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:55.016146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:55.016424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:55.016689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:55.028961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:55.030513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:12:55.047379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:55.048648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:12:55.050094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:12:55.050094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:12:55.050094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:55.050094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 477/985] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:55.054574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:55.111853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:55.170160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4601f49-6a23-4bcd-8b60-4d3b4ae860a1 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:55.207180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:55.207792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:55.208100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:55.208373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:55.209020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:55.209318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:55.210683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:55.230842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 509/986] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:55.232317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:55.336498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b753-7f44-4489-b231-70b646796298 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:55.372343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:55.372994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:55.373269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:55.373531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:55.381335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:55.382842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:12:55.395059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:55.396053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:55.396973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 478/987] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:55.403480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:55.512221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179843-2a9c-4a89-bb24-03e8fa2679ab None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:55.522141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:55.549109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7860f9-c315-4260-8bf9-c89a56e6aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:55.549715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7860f9-c315-4260-8bf9-c89a56e6aa17 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:55.549991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7860f9-c315-4260-8bf9-c89a56e6aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:55.550260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7860f9-c315-4260-8bf9-c89a56e6aa17 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:55.550954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7860f9-c315-4260-8bf9-c89a56e6aa17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:55.551318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7860f9-c315-4260-8bf9-c89a56e6aa17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:55.552759 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7860f9-c315-4260-8bf9-c89a56e6aa17 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:55.570958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 510/988] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:55.572371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:55.611898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:55.689570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6df0af-0ceb-42ec-ae46-762411abdbee None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:55.727842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f1272-dbc4-485c-870b-3478bdf05e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:55.729006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f1272-dbc4-485c-870b-3478bdf05e76 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:55.729279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f1272-dbc4-485c-870b-3478bdf05e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:55.729544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f1272-dbc4-485c-870b-3478bdf05e76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:55.730281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f1272-dbc4-485c-870b-3478bdf05e76 None admin] RBAC: Adding query filter params (role.id=fc3f67737c7f4cdfb5276cba7df80d15, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=09dd7aa113ee4a83b06726b37b522eaa) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:55.730584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f1272-dbc4-485c-870b-3478bdf05e76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:55.732054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f1272-dbc4-485c-870b-3478bdf05e76 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:55.741020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 479/989] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:12:55 2022] GET /identity/v3/role_assignments?user.id=09dd7aa113ee4a83b06726b37b522eaa&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=fc3f67737c7f4cdfb5276cba7df80d15 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:56.674011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698337-025a-4c03-a32c-a7d90d0eb61c None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:56.674563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698337-025a-4c03-a32c-a7d90d0eb61c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:56.674563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698337-025a-4c03-a32c-a7d90d0eb61c None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:56.676070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 511/990] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:12:56.681630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ad70d-0328-4be5-9176-93d1fd22d9f8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:56.682021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ad70d-0328-4be5-9176-93d1fd22d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:56.682196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ad70d-0328-4be5-9176-93d1fd22d9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:56.700644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1c3ad70d-0328-4be5-9176-93d1fd22d9f8 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:56.701836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1c3ad70d-0328-4be5-9176-93d1fd22d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:56.772068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 480/991] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:57.042012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698337-025a-4c03-a32c-a7d90d0eb61c None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.149882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698337-025a-4c03-a32c-a7d90d0eb61c None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:57.175255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a41ad-69a6-44c4-b569-cf9536edbee3 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.175541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a41ad-69a6-44c4-b569-cf9536edbee3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.175827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a41ad-69a6-44c4-b569-cf9536edbee3 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.177179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 481/992] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:57.182764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f283-dab5-421e-9c8f-0a2c0c2aac3b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.183036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f283-dab5-421e-9c8f-0a2c0c2aac3b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.183307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f283-dab5-421e-9c8f-0a2c0c2aac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.189122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:57.190166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.190621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.191088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.191677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:57.193551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:57.202647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d0f2f283-dab5-421e-9c8f-0a2c0c2aac3b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:57.203651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:57.204662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:12:57.205505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:57.206243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d0f2f283-dab5-421e-9c8f-0a2c0c2aac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:57.206314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 512/993] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:57.210514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.221755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:57.242779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:57.279799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 482/994] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:12:57.324148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4acc6-81c0-4809-83dd-f80800d9ce41 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:57.358637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:57.359149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.359426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.359699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.360359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:57.360662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:57.362011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:57.371909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 513/995] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:57.372968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2f283-dab5-421e-9c8f-0a2c0c2aac3b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.474964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2f283-dab5-421e-9c8f-0a2c0c2aac3b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:57.509816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:57.510469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.510747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.511019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.511659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:57.511992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:57.513373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:57.518933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 483/996] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:57.524650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.552053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.568795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:57.636792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:57.643195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383d578-e072-4df5-83d9-303eb1690b92 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:57.662343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f69e47-8d1a-4428-979f-e08e8fc50011 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:57.680725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:57.681864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.682139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.682573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.683090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] RBAC: Adding query filter params (interface=public, service_id=dcf8b432c71b4b3da6d63e60b722e021, region_id=RegionOne) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:57.683392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:57.684777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:57.694573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 514/997] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/endpoints?service_id=dcf8b432c71b4b3da6d63e60b722e021&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:57.695558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.704249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:57.704891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.705173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.705455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.706045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:57.707407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:57.716993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:57.718021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:12:57.719283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 484/998] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:12:57.723933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.805724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa61e-e300-4beb-83a6-a4fe1977ce44 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:57.811609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:57.843010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc826d03-9397-4148-b512-dbcfaaf2a474 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:57.851633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:57.852194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.852475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.852745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.853545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:57.854905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:57.861488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 515/999] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:12:57.889294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5b13e-784e-4809-bb71-26d1b21d38be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:57.890032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b13e-784e-4809-bb71-26d1b21d38be None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.890385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b13e-784e-4809-bb71-26d1b21d38be None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.890756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b13e-784e-4809-bb71-26d1b21d38be None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.891489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5b13e-784e-4809-bb71-26d1b21d38be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:57.891894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5b13e-784e-4809-bb71-26d1b21d38be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:57.897386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5b13e-784e-4809-bb71-26d1b21d38be None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:57.904315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 485/1000] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:12:57.909921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:57.937354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be4a92-980d-4640-bb61-1b1498bd41ed None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.937679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be4a92-980d-4640-bb61-1b1498bd41ed None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.937912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be4a92-980d-4640-bb61-1b1498bd41ed None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.940027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 486/1001] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:12:57.944386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:57.946078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f580-e060-402f-9d7d-c551ad6c09cf None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:57.946374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f580-e060-402f-9d7d-c551ad6c09cf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:57.946712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f580-e060-402f-9d7d-c551ad6c09cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:57.966583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0920f580-e060-402f-9d7d-c551ad6c09cf None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:12:57.967832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0920f580-e060-402f-9d7d-c551ad6c09cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:12:58.032514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08ebbd-083f-40af-82bd-4202762a46f9 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:58.044754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 487/1002] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:12:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:12:58.071240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:58.072711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:58.073160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:58.073599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:58.074386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:58.074687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:58.076079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:58.081416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 516/1003] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Sep 14 15:12:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:58.086951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f580-e060-402f-9d7d-c551ad6c09cf None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:58.160931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:58.192789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f580-e060-402f-9d7d-c551ad6c09cf None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:58.229093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:58.229699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:58.229971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:58.230238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:58.230911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:58.232290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:58.255847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 488/1004] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:12:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:12:58.316044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:58.423976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:58.440730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf12-1a63-40f3-addc-29c62597cc39 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:58.485506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:58.486140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:58.486410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:58.486687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:58.487269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:58.488645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:12:58.498130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:12:58.499269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:12:58.500239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 517/1005] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Sep 14 15:12:58 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:12:58.505271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:58.621791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49835e4-6fcb-4aee-8157-b4893f2f5466 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:58.653647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:12:58.659977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5bd62-b1ce-4177-a8ee-c2d187466339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:58.661026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5bd62-b1ce-4177-a8ee-c2d187466339 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:58.661656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5bd62-b1ce-4177-a8ee-c2d187466339 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:58.662311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5bd62-b1ce-4177-a8ee-c2d187466339 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:58.662946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5bd62-b1ce-4177-a8ee-c2d187466339 None admin] RBAC: Adding query filter params (name=image) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:58.663248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5bd62-b1ce-4177-a8ee-c2d187466339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:58.664647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5bd62-b1ce-4177-a8ee-c2d187466339 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:58.674918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 489/1006] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:12:58.676530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:12:58.783375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e610e0c-9743-4f16-9515-f4774d5373e0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:12:58.819550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19e091-4289-4858-8bbf-e344aed4d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:12:58.820183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e091-4289-4858-8bbf-e344aed4d7ff None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:12:58.820461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e091-4289-4858-8bbf-e344aed4d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:12:58.820733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e091-4289-4858-8bbf-e344aed4d7ff None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:12:58.821357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19e091-4289-4858-8bbf-e344aed4d7ff None admin] RBAC: Adding query filter params (type=image) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:12:58.821690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19e091-4289-4858-8bbf-e344aed4d7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:12:58.823041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19e091-4289-4858-8bbf-e344aed4d7ff None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:12:58.836150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 518/1007] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:12:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:00.065063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151fb21-6d3a-4b79-b3a2-c35fab67f764 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.065653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151fb21-6d3a-4b79-b3a2-c35fab67f764 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.065653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151fb21-6d3a-4b79-b3a2-c35fab67f764 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.067116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 490/1008] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:00.072294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad3043-e6ce-4408-a13e-b1590cd39167 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.072739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad3043-e6ce-4408-a13e-b1590cd39167 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.072818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad3043-e6ce-4408-a13e-b1590cd39167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.091911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-a6ad3043-e6ce-4408-a13e-b1590cd39167 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:00.093108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-a6ad3043-e6ce-4408-a13e-b1590cd39167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:00.101292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:00.167853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 519/1009] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:00.429278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151fb21-6d3a-4b79-b3a2-c35fab67f764 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:00.431904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc169ad-ff65-4ad7-9d5a-d9f1a885a345 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.432480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc169ad-ff65-4ad7-9d5a-d9f1a885a345 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.432755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc169ad-ff65-4ad7-9d5a-d9f1a885a345 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.435219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 520/1010] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:00.440539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5fe2-af6a-4e7e-b2eb-867229b1fc81 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.440822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5fe2-af6a-4e7e-b2eb-867229b1fc81 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.441095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5fe2-af6a-4e7e-b2eb-867229b1fc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.460614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-2acc5fe2-af6a-4e7e-b2eb-867229b1fc81 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:00.461980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-2acc5fe2-af6a-4e7e-b2eb-867229b1fc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:00.541912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 521/1011] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:00.544008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151fb21-6d3a-4b79-b3a2-c35fab67f764 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:00.579658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:00.580316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.580591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.580859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.581437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:00.582789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:00.592415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:00.593491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:13:00.594357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:00.596137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 491/1012] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:00.599791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5fe2-af6a-4e7e-b2eb-867229b1fc81 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:00.676082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:00.708063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5fe2-af6a-4e7e-b2eb-867229b1fc81 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:00.744076 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:00.744671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.744942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.745205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.745822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] RBAC: Adding query filter params (name=compute) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:00.746116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:00.747457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:00.752546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 522/1013] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:13:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:00.757887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:00.817149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:00.822700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:00.875932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89258e-05d1-456f-9833-525db3cf6db1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:00.919786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:00.920425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.920695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.920964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.921595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:00.921888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:00.923253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:00.933632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 492/1014] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Sep 14 15:13:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:00.934926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:00.938489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b8678-36ba-40e3-a5bb-13a16cdabada None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:00.979071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90800b4b-bc28-4fa4-8b80-698419f816fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:00.979620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800b4b-bc28-4fa4-8b80-698419f816fb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.979925 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800b4b-bc28-4fa4-8b80-698419f816fb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.980197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800b4b-bc28-4fa4-8b80-698419f816fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.981341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90800b4b-bc28-4fa4-8b80-698419f816fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:00.982764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90800b4b-bc28-4fa4-8b80-698419f816fb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:00.984557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 523/1015] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:00.985506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae753-02ef-471c-9769-f4e1ba1c0cdc None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:00.985785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae753-02ef-471c-9769-f4e1ba1c0cdc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:00.986059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae753-02ef-471c-9769-f4e1ba1c0cdc None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:00.987847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 524/1016] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:00.990256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ae753-02ef-471c-9769-f4e1ba1c0cdc None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:00.995347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:01.045411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3e5a8-afc9-4bbf-8d4f-2986e385f96b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:01.069230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:01.080975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369aa92-d272-40d4-b3e2-6fcda9d91e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:01.081590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369aa92-d272-40d4-b3e2-6fcda9d91e24 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:01.081867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369aa92-d272-40d4-b3e2-6fcda9d91e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:01.082138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369aa92-d272-40d4-b3e2-6fcda9d91e24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:01.082808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369aa92-d272-40d4-b3e2-6fcda9d91e24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:01.084195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369aa92-d272-40d4-b3e2-6fcda9d91e24 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:01.094186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ae753-02ef-471c-9769-f4e1ba1c0cdc None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:01.104085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 493/1017] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:13:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:01.105130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be907-9594-4e57-b667-d56a2ef8073b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:01.105415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be907-9594-4e57-b667-d56a2ef8073b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:01.105691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be907-9594-4e57-b667-d56a2ef8073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:01.125478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5e4be907-9594-4e57-b667-d56a2ef8073b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:01.126747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5e4be907-9594-4e57-b667-d56a2ef8073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:01.154123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:01.154839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:01.155038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:01.155259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:01.157274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:01.158793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:01.192786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 525/1018] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:13:00 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:13:01.221845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 494/1019] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:01 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:01.494379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:01.549567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:01.606224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385085f6-4dcf-48ee-a60c-382681652fe5 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:01.643097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12582cad-e887-45de-a79d-949dacf4b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:01.644124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582cad-e887-45de-a79d-949dacf4b5a9 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:01.644607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582cad-e887-45de-a79d-949dacf4b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:01.645100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582cad-e887-45de-a79d-949dacf4b5a9 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:01.646003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12582cad-e887-45de-a79d-949dacf4b5a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:01.647556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12582cad-e887-45de-a79d-949dacf4b5a9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:01.666249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 526/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:13:01 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:03.379542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e981-8d1e-423f-af54-9c3d913e1c34 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:03.380138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e981-8d1e-423f-af54-9c3d913e1c34 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:03.380138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e981-8d1e-423f-af54-9c3d913e1c34 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:03.381580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 495/1021] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:03.387174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f85ffb-5af9-480c-a1f1-b62bac83ecc3 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:03.387625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f85ffb-5af9-480c-a1f1-b62bac83ecc3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:03.387723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f85ffb-5af9-480c-a1f1-b62bac83ecc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:03.406250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-c0f85ffb-5af9-480c-a1f1-b62bac83ecc3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:03.407426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-c0f85ffb-5af9-480c-a1f1-b62bac83ecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:03.463256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88dcf-3fb1-42ee-a860-5623888c9330 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:03.463540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88dcf-3fb1-42ee-a860-5623888c9330 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:03.463831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88dcf-3fb1-42ee-a860-5623888c9330 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:03.465201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 496/1022] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:03.470544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e476213-b182-4827-bc6d-c209c52df32c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:03.470831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e476213-b182-4827-bc6d-c209c52df32c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:03.471109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e476213-b182-4827-bc6d-c209c52df32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:03.484593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 527/1023] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:03.490763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1e476213-b182-4827-bc6d-c209c52df32c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:03.492002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1e476213-b182-4827-bc6d-c209c52df32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:03.561710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 497/1024] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:03.754280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f85ffb-5af9-480c-a1f1-b62bac83ecc3 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:03.796152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:03.831533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e476213-b182-4827-bc6d-c209c52df32c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:03.863477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f85ffb-5af9-480c-a1f1-b62bac83ecc3 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:03.877509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:03.909696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc570-6f6f-4d0d-b274-c27eca70ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:03.910325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc570-6f6f-4d0d-b274-c27eca70ad43 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:03.910603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc570-6f6f-4d0d-b274-c27eca70ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:03.910870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc570-6f6f-4d0d-b274-c27eca70ad43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:03.923432 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fc570-6f6f-4d0d-b274-c27eca70ad43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-4e5fc570-6f6f-4d0d-b274-c27eca70ad43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:03.929008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:03.930005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:03.932001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 528/1025] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Sep 14 15:13:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:03.932993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f5b7-6400-4361-a307-0d4b8b6370a2 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:03.932993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f5b7-6400-4361-a307-0d4b8b6370a2 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:03.932993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f5b7-6400-4361-a307-0d4b8b6370a2 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:03.934388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 529/1026] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:03.936835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3f5b7-6400-4361-a307-0d4b8b6370a2 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:03.964463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e476213-b182-4827-bc6d-c209c52df32c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:03.998808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3fbaf-3ab3-4db5-9a71-deee5612042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:03.999435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3fbaf-3ab3-4db5-9a71-deee5612042e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:03.999713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3fbaf-3ab3-4db5-9a71-deee5612042e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.000012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3fbaf-3ab3-4db5-9a71-deee5612042e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.001107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3fbaf-3ab3-4db5-9a71-deee5612042e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.002536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3fbaf-3ab3-4db5-9a71-deee5612042e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.004367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 498/1027] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:04.005262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26641e33-aa53-4254-840c-7a6f1b60d7e7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.005534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26641e33-aa53-4254-840c-7a6f1b60d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.005867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26641e33-aa53-4254-840c-7a6f1b60d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.023667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-26641e33-aa53-4254-840c-7a6f1b60d7e7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:04.024946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-26641e33-aa53-4254-840c-7a6f1b60d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:04.035501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:04.041133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3f5b7-6400-4361-a307-0d4b8b6370a2 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.074855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.075379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.075649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.075978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.076597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:04.076889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.078240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.086922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 530/1028] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Sep 14 15:13:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:04.087863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.092773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 499/1029] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:04.093492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26641e33-aa53-4254-840c-7a6f1b60d7e7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.145232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:04.200162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2122ed-e570-4ac2-a161-c40ecf13b7a3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.211962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26641e33-aa53-4254-840c-7a6f1b60d7e7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.244829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.245438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.245703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.245975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.246689 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.248163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.253504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.254574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.255274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.255698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.269665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.271450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.283989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 531/1030] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:04 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:04.288053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:04.289107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:04.290027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:04.290027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:04.290027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:04.292155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 500/1031] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:04.297217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.324778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:04.397803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.422778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a720b4f-7f7a-4f96-9ba8-f37bcaad852e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.461107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.461722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.461998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.462266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.462908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:04.463207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.464604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.477405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 532/1032] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:04.483503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.506100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:04.518825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecec89d-e0cb-42aa-bdfd-823539135565 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.558696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.559343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.559624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.559944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] PATH_INFO: `/v3/services/image` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.560538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.561908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.572711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:04.573639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:04.574798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:04.575774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 501/1033] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:04.582990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.613341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30c3a2-3efa-4373-918b-e721e2829ac6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.655390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.656332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.656860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.657271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.665176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.667222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:13:04.679986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:04.681064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:04.682419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 533/1034] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:04.687183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.698442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd198-1e76-4547-be37-63f92e89cf92 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.733525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.734145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.734422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.734692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.735321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] RBAC: Adding query filter params (name=image) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:04.735619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.737021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.741944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 502/1035] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:04.747798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.765960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:04.805813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5cbdf-c6e3-4048-9c40-e7dccb715415 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.844509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.845128 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.845411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.845655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.846384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:04.846683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.848172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.851526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:04.858467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70205564-d91c-4a5a-b274-8c5faad61a18 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:04.868489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 534/1036] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:04.874606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:04.904999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:04.905805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:04.906090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:04.906363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:04.907014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] RBAC: Adding query filter params (type=image) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:04.907315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:04.908921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:04.914328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 503/1037] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:04.921375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:05.002433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc503659-fdf1-480d-a4d0-ea1a7a773195 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:05.007112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:05.028048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24658f4-1613-49c5-95a6-39c9a71d8595 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:05.047623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:05.048272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:05.049092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:05.049372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:05.065231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:05.065970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:05.066254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:05.066527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:05.067403 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] RBAC: Adding query filter params (interface=public, service_id=fde884be179849829a3337fc8cea0f28, region_id=RegionOne) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:05.068133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:05.069798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:05.077168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 504/1038] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/endpoints?service_id=fde884be179849829a3337fc8cea0f28&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:05.083051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:05.121489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:05.130862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:05.132573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:05.194846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5b6d-1d00-4f6c-96d2-6f9e2ed412ef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:05.234521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:05.235405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:05.235685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:05.235995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:05.236619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:05.238096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:05.252377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 505/1039] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:13:05 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:13:05.252586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 535/1040] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 15:13:05.254132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:05.268025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:05.367748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b23ae-c768-41bc-8346-f6132232d196 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:05.406303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:05.406985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:05.407217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:05.407481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:05.418974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:05.420539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:05.438512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:05.439527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:05.440479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:05.440479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:05.440479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:05.443933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 506/1041] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:05.445859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:05.548455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:05.557418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568936-91e8-45af-8a8a-84c3f13d9a8e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:05.593436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:05.594427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:05.594937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:05.595416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:05.596357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:05.596865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:05.598424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:05.611372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 536/1042] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:05.620892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:05.688523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:05.730687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b9fa-b717-4681-af94-01de210316e4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:05.767010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:05.767640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:05.767944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:05.768217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:05.775033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:05.776751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:13:05.788148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:05.789164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:05.790073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 507/1043] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:05.795797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:05.899749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865ccb3-1f92-4d45-a4dc-7f7dbd91d7e9 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:05.941920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d9ab8-5bfe-45fd-a837-36b493831e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:05.942537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d9ab8-5bfe-45fd-a837-36b493831e59 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:05.942813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d9ab8-5bfe-45fd-a837-36b493831e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:05.943083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d9ab8-5bfe-45fd-a837-36b493831e59 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:05.943780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d9ab8-5bfe-45fd-a837-36b493831e59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:05.944113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d9ab8-5bfe-45fd-a837-36b493831e59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:05.945540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d9ab8-5bfe-45fd-a837-36b493831e59 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:05.959250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 537/1044] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:05.965181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:06.068865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0036-2fce-46da-9602-10760dbb2097 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:06.091833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:06.104828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4f3d-9c34-438b-ad25-82dcc777e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:06.105661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4f3d-9c34-438b-ad25-82dcc777e810 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:06.106082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4f3d-9c34-438b-ad25-82dcc777e810 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:06.106498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4f3d-9c34-438b-ad25-82dcc777e810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:06.107364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4f3d-9c34-438b-ad25-82dcc777e810 None admin] RBAC: Adding query filter params (role.id=fc3f67737c7f4cdfb5276cba7df80d15, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=76b507a36c834754bd4ac76935e64b89) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:06.107850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4f3d-9c34-438b-ad25-82dcc777e810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:06.109418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4f3d-9c34-438b-ad25-82dcc777e810 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:06.115567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 508/1045] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:05 2022] GET /identity/v3/role_assignments?user.id=76b507a36c834754bd4ac76935e64b89&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=fc3f67737c7f4cdfb5276cba7df80d15 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:06.547548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798496-c7df-49fd-9fdb-ae2fe3f8d41c None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:06.548101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798496-c7df-49fd-9fdb-ae2fe3f8d41c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:06.548101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798496-c7df-49fd-9fdb-ae2fe3f8d41c None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:06.549625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 538/1046] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:06.554815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5e9f-e777-45ea-9626-6dd90a58fc73 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:06.555221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5e9f-e777-45ea-9626-6dd90a58fc73 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:06.555391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5e9f-e777-45ea-9626-6dd90a58fc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:06.573850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8ecc5e9f-e777-45ea-9626-6dd90a58fc73 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:06.575033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8ecc5e9f-e777-45ea-9626-6dd90a58fc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:06.651669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 509/1047] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:06.921964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798496-c7df-49fd-9fdb-ae2fe3f8d41c None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:06.939192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:07.035540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798496-c7df-49fd-9fdb-ae2fe3f8d41c None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:07.070566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:07.071233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.072097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.072362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.082526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:07.087343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:07.088557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:07.089836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:07.092172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 539/1048] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:07.094421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc5e9f-e777-45ea-9626-6dd90a58fc73 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:07.193713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc5e9f-e777-45ea-9626-6dd90a58fc73 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:07.211068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:07.230354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:07.230833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.231102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.231367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.232052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:07.232353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:07.233701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:07.241925 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 510/1049] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:07.248181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:07.337490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:07.369188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343238a6-94a4-4194-9ad6-74102bb9f543 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:07.408771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a9fb-acf1-490a-9c42-1a92af03867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:07.409331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a9fb-acf1-490a-9c42-1a92af03867b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.409609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a9fb-acf1-490a-9c42-1a92af03867b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.409880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a9fb-acf1-490a-9c42-1a92af03867b None admin] PATH_INFO: `/v3/users/a44906f1dbe94338b7c83dc9bcb4cd55` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.424919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a9fb-acf1-490a-9c42-1a92af03867b None admin] RBAC: Authorizing `identity:get_user(user_id=a44906f1dbe94338b7c83dc9bcb4cd55)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:07.426358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a9fb-acf1-490a-9c42-1a92af03867b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:07.432069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 540/1050] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:07 2022] GET /identity/v3/users/a44906f1dbe94338b7c83dc9bcb4cd55 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:07.434939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:07.472625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdbb91-bf41-4053-a2e7-641a0e8321da None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.472818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdbb91-bf41-4053-a2e7-641a0e8321da None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.473078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdbb91-bf41-4053-a2e7-641a0e8321da None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.474566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 541/1051] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:07.479902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b726e2b-5167-4166-8c5d-0a7aed453b67 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.480189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b726e2b-5167-4166-8c5d-0a7aed453b67 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.480463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b726e2b-5167-4166-8c5d-0a7aed453b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.498625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-8b726e2b-5167-4166-8c5d-0a7aed453b67 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:07.499961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8b726e2b-5167-4166-8c5d-0a7aed453b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:07.541929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ffd30-3505-4e2c-81fc-f4fa14744e65 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:07.573082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 542/1052] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:07.577027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:07.577635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.577906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.578170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.631648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:07.656270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:07.657767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:07.759779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 511/1053] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:07 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:13:07.765811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b726e2b-5167-4166-8c5d-0a7aed453b67 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:07.826955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:07.843453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:07.872554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b726e2b-5167-4166-8c5d-0a7aed453b67 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:07.918438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:07.919922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.920206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.920476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.921658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] RBAC: Authorizing `identity:get_project(project_id=055d92ce3cab42aa9703111c0e4bc2c0)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:07.923081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:07.930195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 543/1054] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:07 2022] GET /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:07.930742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:07.932405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:07.951451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885bfc5-bc81-4dfd-834e-cd93785d3327 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:07.989313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:07.989946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:07.990249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:07.990493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:07.991077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:07.992485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:08.004131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:08.005219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:08.006073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 512/1055] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Sep 14 15:13:07 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:08.011837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:08.042908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2c968-c5c9-42ea-8885-d0bf7d780b57 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:08.075916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:08.082331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:08.082938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:08.083216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:08.083489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:08.084251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0, user.id=a44906f1dbe94338b7c83dc9bcb4cd55) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:08.084558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:08.085995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:08.093236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 544/1056] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:07 2022] GET /identity/v3/role_assignments?user.id=a44906f1dbe94338b7c83dc9bcb4cd55&scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:08.127830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3abb3-c087-4eb9-acaa-a549384f25d8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:08.169154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ff656-4a4d-46a0-b104-29d1c85320e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:08.169800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ff656-4a4d-46a0-b104-29d1c85320e5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:08.170079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ff656-4a4d-46a0-b104-29d1c85320e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:08.170355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ff656-4a4d-46a0-b104-29d1c85320e5 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:08.171026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ff656-4a4d-46a0-b104-29d1c85320e5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:08.171331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ff656-4a4d-46a0-b104-29d1c85320e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:08.172840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ff656-4a4d-46a0-b104-29d1c85320e5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:08.178903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 513/1057] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:08.185069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:08.283122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f6ed-684b-42f4-9c8e-a1971239b89e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:08.283418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f6ed-684b-42f4-9c8e-a1971239b89e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:08.283638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f6ed-684b-42f4-9c8e-a1971239b89e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:08.284986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 514/1058] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:08.290021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce99d7-8b49-465b-96aa-cc99b8604caf None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:08.290354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce99d7-8b49-465b-96aa-cc99b8604caf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:08.290630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce99d7-8b49-465b-96aa-cc99b8604caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:08.297257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322b4c7-68c5-4484-8219-50268ede31e7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:08.305186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:08.313926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5bce99d7-8b49-465b-96aa-cc99b8604caf None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:08.317200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5bce99d7-8b49-465b-96aa-cc99b8604caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:08.339988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:08.340603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:08.340882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:08.341152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:08.341790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] RBAC: Adding query filter params (type=image) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:08.342095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:08.343462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:08.348611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 545/1059] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:08.354200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:08.408633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 515/1060] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:08.414247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:08.462806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafcea7-7f9e-4c96-9254-637f8e4e2002 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:08.506093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:08.506698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:08.506975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:08.507243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:08.507953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:08.509883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:08.533777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 546/1061] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:13:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:08.683225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce99d7-8b49-465b-96aa-cc99b8604caf None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:08.800080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce99d7-8b49-465b-96aa-cc99b8604caf None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:08.847252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:08.854659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:08.855419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:08.855697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:08.855989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:08.867599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:08.873331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:08.874294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:08.875167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 516/1062] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Sep 14 15:13:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:08.880632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:08.986372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b39351-8e1d-4451-9bb4-6faedacaf65f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:09.002957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:09.026673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:09.027279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:09.027555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:09.027844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:09.028510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:09.028810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:09.030170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:09.038934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 547/1063] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Sep 14 15:13:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:09.044871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:09.151305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82356-e84b-4a8b-ab67-86e317c88bfe None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:09.186146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:09.187195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:09.187657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:09.188127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:09.199152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:09.200878 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:09.216902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:09.217877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:09.218795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:09.218795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:09.218795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:09.223940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 517/1064] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:09.226992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:09.328486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1ac13-758b-459d-a137-6e41b231f135 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:09.364982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:09.365991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:09.366494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:09.366965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:09.367804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:09.368370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:09.369983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:09.386564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 548/1065] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:09.387855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:09.436619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:09.493118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c527c-afb1-41a7-82e7-1defa1ff219c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:09.528321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:09.528977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:09.529250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:09.529513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:09.538370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:09.539847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:13:09.551627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:09.552797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:09.553781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 518/1066] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:13:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:09.560663 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:09.603629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:09.677819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fc1a5-04ce-4b25-b0e7-7647270f048e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:09.713852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:09.714374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:09.714652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:09.714924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:09.715649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:09.715979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:09.717396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:09.740705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 549/1067] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:13:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:09.741917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:09.846073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2289db-b975-4a6f-9283-c4a37dfafca7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:09.848484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:09.887805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:09.888459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:09.888737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:09.889009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:09.901264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:09.902728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:09.917656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:09.918828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:09.919957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:09.919957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:09.919957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:09.919957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 519/1068] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:09.925674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:10.027550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:10.035735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d6b90-3848-4757-88b7-edd2da4ad36d None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:10.070023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:10.070629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.070900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.071166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.072434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:10.072733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:10.074089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:10.090176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 550/1069] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:10.091585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:10.198250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f001-96f5-45e8-936c-1a9a3fd0f4be None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:10.233374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da73dc-870a-4957-97e3-4241af08ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:10.234006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da73dc-870a-4957-97e3-4241af08ac1f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.234285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da73dc-870a-4957-97e3-4241af08ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.234554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da73dc-870a-4957-97e3-4241af08ac1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.241237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da73dc-870a-4957-97e3-4241af08ac1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:10.242681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da73dc-870a-4957-97e3-4241af08ac1f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-75da73dc-870a-4957-97e3-4241af08ac1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:13:10.254546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:10.255453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:10.260792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 520/1070] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:10.263394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:10.296259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44f5d-951b-40f9-af7e-3d82dabb075a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.296469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44f5d-951b-40f9-af7e-3d82dabb075a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.296744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44f5d-951b-40f9-af7e-3d82dabb075a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.298239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 521/1071] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:10.303103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2faf-455b-44b9-8d7a-3259d48f6ac7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.303389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2faf-455b-44b9-8d7a-3259d48f6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.303668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2faf-455b-44b9-8d7a-3259d48f6ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.322387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9f4a2faf-455b-44b9-8d7a-3259d48f6ac7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:10.323589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9f4a2faf-455b-44b9-8d7a-3259d48f6ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:10.335066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:10.371098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a84ab3-609f-44a5-a667-84f4b8c71e04 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:10.394441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 522/1072] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:10.407876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:10.408486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.408762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.409031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.409719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:10.410021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:10.411438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:10.424853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 551/1073] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:13:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:10.433099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a2faf-455b-44b9-8d7a-3259d48f6ac7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:10.537525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a2faf-455b-44b9-8d7a-3259d48f6ac7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:10.572630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a4cd-7f58-4b78-a459-eb15bd02343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:10.573158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a4cd-7f58-4b78-a459-eb15bd02343b None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.573436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a4cd-7f58-4b78-a459-eb15bd02343b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.573707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a4cd-7f58-4b78-a459-eb15bd02343b None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/76b507a36c834754bd4ac76935e64b89/roles/fc3f67737c7f4cdfb5276cba7df80d15` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.575905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a4cd-7f58-4b78-a459-eb15bd02343b None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=76b507a36c834754bd4ac76935e64b89, role_id=fc3f67737c7f4cdfb5276cba7df80d15)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:10.577348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a4cd-7f58-4b78-a459-eb15bd02343b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:10.591472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 523/1074] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:10 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/76b507a36c834754bd4ac76935e64b89/roles/fc3f67737c7f4cdfb5276cba7df80d15 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:13:10.666586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:10.684043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:10.792920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b399b-4829-40dd-9b48-eebe01f38727 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:10.827839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:10.828782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.829244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.829693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.840619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:10.846088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:10.847087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:10.848061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:10.849858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 552/1075] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:10.851836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f8e2-86a2-4e6a-8039-aef92ac74d98 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.852296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f8e2-86a2-4e6a-8039-aef92ac74d98 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.852385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f8e2-86a2-4e6a-8039-aef92ac74d98 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.854318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 524/1076] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:10.856336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:10.859273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dd1e9-e729-43f5-8cea-51307a0b6145 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:10.859559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dd1e9-e729-43f5-8cea-51307a0b6145 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:10.859855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dd1e9-e729-43f5-8cea-51307a0b6145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:10.872704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:10.879529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b82dd1e9-e729-43f5-8cea-51307a0b6145 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:10.881590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b82dd1e9-e729-43f5-8cea-51307a0b6145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:10.944066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:10.960082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 525/1077] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:10.981509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a779b63-d357-48cc-b212-2531b84f86bd None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:11.019262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:11.020152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:11.020785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:11.021205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:11.022021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:11.022482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:11.024227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:11.034463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 553/1078] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:11.040333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dd1e9-e729-43f5-8cea-51307a0b6145 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:11.143863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dd1e9-e729-43f5-8cea-51307a0b6145 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:11.178343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:11.178964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:11.179236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:11.179499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] PATH_INFO: `/v3/users/a44906f1dbe94338b7c83dc9bcb4cd55` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:11.180955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] RBAC: Authorizing `identity:get_user(user_id=a44906f1dbe94338b7c83dc9bcb4cd55)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:11.183094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:11.185068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 526/1079] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:11 2022] GET /identity/v3/users/a44906f1dbe94338b7c83dc9bcb4cd55 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:11.190531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:11.244925 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:11.248824 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:11.302153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d4ef6-90fd-4065-8824-b61ad3dda33a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:11.338094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:11.338729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:11.338998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:11.339261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:11.340437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] RBAC: Authorizing `identity:get_project(project_id=055d92ce3cab42aa9703111c0e4bc2c0)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:11.341911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:11.343568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 554/1080] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:11 2022] GET /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:11.349458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:11.353345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:11.360947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963a28-86ef-4104-b601-60c32bd2373b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:11.404687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:11.405322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:11.405639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:11.405963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:11.463140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6de1-6af4-4137-88c8-3c10676d9ddf None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:11.477113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:11.478575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:11.482364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:11.500205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:11.500971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:11.501330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:11.501606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0/users/a44906f1dbe94338b7c83dc9bcb4cd55/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:11.503704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] RBAC: Authorizing `identity:create_grant(project_id=055d92ce3cab42aa9703111c0e4bc2c0, user_id=a44906f1dbe94338b7c83dc9bcb4cd55, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:11.505213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:11.521334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 555/1081] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:11 2022] PUT /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0/users/a44906f1dbe94338b7c83dc9bcb4cd55/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:13:11.605932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 527/1082] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 15:13:11.611620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:11.681617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:11.722036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383b01-f893-474a-9ef6-3cff9ddfdb0e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:11.758054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84ade-f33b-4fad-8056-6e1cc2a2ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:11.758749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84ade-f33b-4fad-8056-6e1cc2a2ef87 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:11.759029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84ade-f33b-4fad-8056-6e1cc2a2ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:11.759300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84ade-f33b-4fad-8056-6e1cc2a2ef87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:11.770212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84ade-f33b-4fad-8056-6e1cc2a2ef87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:11.771657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84ade-f33b-4fad-8056-6e1cc2a2ef87 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-64b84ade-f33b-4fad-8056-6e1cc2a2ef87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:11.786395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:11.787445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:11.788951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:11.788951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:11.788951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:11.788951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 556/1083] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:11.794011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:11.900204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e3f00-54c6-4146-a6e4-a31f4b03355d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:11.903103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:11.940088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6d9b0-3feb-4143-acd9-4991d1662e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:11.940699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d9b0-3feb-4143-acd9-4991d1662e6b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:11.941043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d9b0-3feb-4143-acd9-4991d1662e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:11.941380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d9b0-3feb-4143-acd9-4991d1662e6b None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:11.942091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6d9b0-3feb-4143-acd9-4991d1662e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:11.942461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6d9b0-3feb-4143-acd9-4991d1662e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:11.943905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6d9b0-3feb-4143-acd9-4991d1662e6b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:11.963845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 528/1084] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:12.813623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd008-5f7c-453a-a25c-290d2a2d891f None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:12.814175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd008-5f7c-453a-a25c-290d2a2d891f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:12.814175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd008-5f7c-453a-a25c-290d2a2d891f None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:12.815524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 557/1085] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:12.820825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9d278-d26d-442a-8c1e-bb8341dd02b3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:12.821117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9d278-d26d-442a-8c1e-bb8341dd02b3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:12.821920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9d278-d26d-442a-8c1e-bb8341dd02b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:12.840383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7da9d278-d26d-442a-8c1e-bb8341dd02b3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:12.841568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7da9d278-d26d-442a-8c1e-bb8341dd02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:12.908138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 529/1086] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:13.184733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd008-5f7c-453a-a25c-290d2a2d891f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:13.292950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd008-5f7c-453a-a25c-290d2a2d891f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:13.309352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:13.326915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:13.327542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.327842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.328112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.338921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:13.343828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:13.344983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 15:13:13.346068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:13.347952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 558/1087] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Sep 14 15:13:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:13.350943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9d278-d26d-442a-8c1e-bb8341dd02b3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:13.441927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:13.449045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9d278-d26d-442a-8c1e-bb8341dd02b3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:13.482026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:13.482626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.482898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.483163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.483831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:13.484140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:13.485489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:13.493871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 530/1088] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Sep 14 15:13:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:13.499733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:13.604442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579c24b-0bcd-4724-87aa-34933d5630cd None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:13.638704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a457-dbcd-40a3-b331-85e3dcabfd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:13.639332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a457-dbcd-40a3-b331-85e3dcabfd29 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.639609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a457-dbcd-40a3-b331-85e3dcabfd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.639911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a457-dbcd-40a3-b331-85e3dcabfd29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.651280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a457-dbcd-40a3-b331-85e3dcabfd29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:13.652755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a457-dbcd-40a3-b331-85e3dcabfd29 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-32d8a457-dbcd-40a3-b331-85e3dcabfd29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:13.667435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:13.668467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:13.669712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:13.669712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:13.669712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:13.669712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 559/1089] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:13.674360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:13.688185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa03d5-0629-4215-8af5-957e610585a4 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.688465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa03d5-0629-4215-8af5-957e610585a4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.688736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa03d5-0629-4215-8af5-957e610585a4 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.690643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 560/1090] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:13.695794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9e5f9-969f-48b2-98e6-956c24473826 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.696052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9e5f9-969f-48b2-98e6-956c24473826 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.696326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9e5f9-969f-48b2-98e6-956c24473826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.715959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4bc9e5f9-969f-48b2-98e6-956c24473826 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:13.717147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4bc9e5f9-969f-48b2-98e6-956c24473826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:13.741116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:13.776150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18222-6910-45a9-831c-ebea86874dba None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:13.786946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 561/1091] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:13.811102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adaca-5517-471f-b216-a931421716ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:13.811704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adaca-5517-471f-b216-a931421716ef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.812011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adaca-5517-471f-b216-a931421716ef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.812286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adaca-5517-471f-b216-a931421716ef None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.812924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292adaca-5517-471f-b216-a931421716ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:13.813247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292adaca-5517-471f-b216-a931421716ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:13.814596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292adaca-5517-471f-b216-a931421716ef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:13.826539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 531/1092] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:13.832114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9e5f9-969f-48b2-98e6-956c24473826 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:13.934525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9e5f9-969f-48b2-98e6-956c24473826 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:13.967838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:13.968399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.968677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.968947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.975909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:13.978188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:13:13.989841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:13.990973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:13.991989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 562/1093] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Sep 14 15:13:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:13.996787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adaca-5517-471f-b216-a931421716ef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.016193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.055856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.076541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.101672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adaca-5517-471f-b216-a931421716ef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.135756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.136461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.136667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.136937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.137667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:14.137968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.139385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.157002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 532/1094] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Sep 14 15:13:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:14.161651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba184fa-55b2-49ee-b1da-3a3b0719642b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.162789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.195311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.195967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.196903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.197200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.207957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:14.213418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:14.214360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:14.215303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 563/1095] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:14.220501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.239728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.265687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5513c1-1946-4d0f-b1f7-1fea33ad900b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.299266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.300985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.301705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.301989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.302261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.322646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75a6b5-2f5e-4404-99e0-26bb0db4f7ae None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.357441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.358038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.358311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.358573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.359222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:14.359518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.360902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.369846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 564/1096] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:14.369993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.371468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.375709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.445291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.476700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 533/1097] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 15:13:14.476887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e49cd-b3f9-4f66-a548-4c24aba73421 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.477705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.512638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.513261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.513532 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.513799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] PATH_INFO: `/v3/users/a44906f1dbe94338b7c83dc9bcb4cd55` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.514922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] RBAC: Authorizing `identity:get_user(user_id=a44906f1dbe94338b7c83dc9bcb4cd55)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.516363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.517947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 565/1098] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/users/a44906f1dbe94338b7c83dc9bcb4cd55 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:14.523539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.534256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.579306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5676646-b058-4f59-a9de-dacc8fc8d6ad None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.616113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.616808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.617085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.617380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.624832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b46d88-a5c6-469e-b0e6-25c3617465b0 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.628146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.629531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:14.645130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:14.646219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:14.647581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:14.647581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:14.647581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:14.647581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 534/1099] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:14.652522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.659426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.660054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.660363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.660611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.681472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.729638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.731010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.740531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.756918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3715297-224a-4008-bac4-a3f1756ce7cb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.791174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.791781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.792107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.792366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.793005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:14.793307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.794671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.807007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 535/1100] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:14.812798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.832695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 566/1101] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 15:13:14.838840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.898836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.914457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0faee9-4254-4f4b-bf61-8af20e91e435 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.939195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe3ee3-f9f0-47ad-8546-aa6fc8ad1244 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.948682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:14.949407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.950155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.950812 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.951093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.957795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.959244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:13:14.971355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:14.972359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:14.973278 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 536/1102] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:14.974227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.974849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.975118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.975381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.976492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=055d92ce3cab42aa9703111c0e4bc2c0)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.978430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.978881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.984120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 567/1103] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:14.985868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:15.082064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060ed87-a63f-47df-a136-46831ffa9383 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:15.083338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538a4e-fc28-447f-9527-ca5ede348ca8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:15.117381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6cd5b-7d6c-4134-819c-89343f3335f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:15.117753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:15.118004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6cd5b-7d6c-4134-819c-89343f3335f3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:15.118287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6cd5b-7d6c-4134-819c-89343f3335f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:15.118377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:15.118560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6cd5b-7d6c-4134-819c-89343f3335f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:15.118660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:15.118903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:15.119249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6cd5b-7d6c-4134-819c-89343f3335f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:15.119554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6cd5b-7d6c-4134-819c-89343f3335f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:15.119641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0, user.id=a44906f1dbe94338b7c83dc9bcb4cd55) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:15.120006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:15.121020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6cd5b-7d6c-4134-819c-89343f3335f3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:15.121592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:15.127056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 568/1104] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/role_assignments?user.id=a44906f1dbe94338b7c83dc9bcb4cd55&scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:15.132721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 537/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:15.138941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:15.191939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:15.260105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419241f5-a0e6-4b21-8f07-66dc36a802e7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:15.297220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192127f-d5a3-4d59-aaa4-f3d07274d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:15.297903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192127f-d5a3-4d59-aaa4-f3d07274d898 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:15.298089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192127f-d5a3-4d59-aaa4-f3d07274d898 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:15.298355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192127f-d5a3-4d59-aaa4-f3d07274d898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:15.299091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192127f-d5a3-4d59-aaa4-f3d07274d898 None admin] RBAC: Adding query filter params (role.id=fc3f67737c7f4cdfb5276cba7df80d15, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=76b507a36c834754bd4ac76935e64b89) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:15.299388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192127f-d5a3-4d59-aaa4-f3d07274d898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:15.300823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192127f-d5a3-4d59-aaa4-f3d07274d898 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:15.306801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 569/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:15 2022] GET /identity/v3/role_assignments?user.id=76b507a36c834754bd4ac76935e64b89&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=fc3f67737c7f4cdfb5276cba7df80d15 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:17.361769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a5dc-ba2f-445a-b6e9-f4290ce2e837 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:17.362304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a5dc-ba2f-445a-b6e9-f4290ce2e837 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:17.362304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a5dc-ba2f-445a-b6e9-f4290ce2e837 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:17.363668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 538/1107] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:17.368938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2b92a-006c-414f-ac7f-d11b11017612 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:17.369376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2b92a-006c-414f-ac7f-d11b11017612 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:17.369471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2b92a-006c-414f-ac7f-d11b11017612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:17.388085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-13c2b92a-006c-414f-ac7f-d11b11017612 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:17.389302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-13c2b92a-006c-414f-ac7f-d11b11017612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:17.455241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 570/1108] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:17.763106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a5dc-ba2f-445a-b6e9-f4290ce2e837 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:17.772606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:17.863351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a5dc-ba2f-445a-b6e9-f4290ce2e837 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:17.895799 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29556bb2-670a-46ae-81bc-4e55cb114675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:17.896452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556bb2-670a-46ae-81bc-4e55cb114675 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:17.896727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556bb2-670a-46ae-81bc-4e55cb114675 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:17.896995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556bb2-670a-46ae-81bc-4e55cb114675 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:17.898116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29556bb2-670a-46ae-81bc-4e55cb114675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:17.900142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29556bb2-670a-46ae-81bc-4e55cb114675 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:17.901994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 539/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:17.907772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2b92a-006c-414f-ac7f-d11b11017612 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:17.940194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:18.021430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2b92a-006c-414f-ac7f-d11b11017612 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:18.066664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f514bb-4d4e-43c1-adba-209672514520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:18.067537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f514bb-4d4e-43c1-adba-209672514520 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:18.068031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f514bb-4d4e-43c1-adba-209672514520 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:18.068408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f514bb-4d4e-43c1-adba-209672514520 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:18.069133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f514bb-4d4e-43c1-adba-209672514520 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:18.071955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f514bb-4d4e-43c1-adba-209672514520 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:18.096817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 571/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:17 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:20.315346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412e13f-dc7b-4bbc-8e3a-75be6925027e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.315934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412e13f-dc7b-4bbc-8e3a-75be6925027e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.315934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412e13f-dc7b-4bbc-8e3a-75be6925027e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.317257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 540/1111] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:20.323100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1575-123e-4113-98da-eed4e70d89c7 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.323482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1575-123e-4113-98da-eed4e70d89c7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.323653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1575-123e-4113-98da-eed4e70d89c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.342277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-dbcb1575-123e-4113-98da-eed4e70d89c7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:20.343475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-dbcb1575-123e-4113-98da-eed4e70d89c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:20.414181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 572/1112] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:20.685827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412e13f-dc7b-4bbc-8e3a-75be6925027e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:20.760623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:20.786289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412e13f-dc7b-4bbc-8e3a-75be6925027e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:20.819318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:20.819969 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.820247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.820516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] PATH_INFO: `/v3/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.821931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] RBAC: Authorizing `identity:get_role(role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:20.823297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:20.824666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 541/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:20.830438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb1575-123e-4113-98da-eed4e70d89c7 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:20.850873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:20.929050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb1575-123e-4113-98da-eed4e70d89c7 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:20.963877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:20.964503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.964776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.965045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] PATH_INFO: `/v3/users/b9935d6cdd9c4c56b74eace8075b99f3` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.978654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] RBAC: Authorizing `identity:get_user(user_id=b9935d6cdd9c4c56b74eace8075b99f3)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:20.980150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:20.981772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 573/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/users/b9935d6cdd9c4c56b74eace8075b99f3 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:20.987595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:21.085163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48052d1-fa34-4d3a-a8e8-6664803e233f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:21.119081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:21.119609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:21.119914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:21.120185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:21.131644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:21.187470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:21.188975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:21.285975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 542/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:13:21.292712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:21.370226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:21.393267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62362129-039c-407c-b889-56cb7ce568a6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:21.446458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db013def-9335-4226-86a7-c6e6c581c9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:21.447080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013def-9335-4226-86a7-c6e6c581c9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:21.447352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013def-9335-4226-86a7-c6e6c581c9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:21.447620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013def-9335-4226-86a7-c6e6c581c9e5 None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:21.448749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db013def-9335-4226-86a7-c6e6c581c9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=055d92ce3cab42aa9703111c0e4bc2c0)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:21.450173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db013def-9335-4226-86a7-c6e6c581c9e5 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:21.451796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 574/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:21 2022] GET /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:21.458168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:21.501890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:21.558007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2716c5-425c-4484-b467-25481010ab01 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:21.592003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01cb0f-bec3-4e1a-91a6-7565ee294166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:21.592599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cb0f-bec3-4e1a-91a6-7565ee294166 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:21.592876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cb0f-bec3-4e1a-91a6-7565ee294166 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:21.593147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cb0f-bec3-4e1a-91a6-7565ee294166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:21.593897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01cb0f-bec3-4e1a-91a6-7565ee294166 None admin] RBAC: Adding query filter params (role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0, user.id=b9935d6cdd9c4c56b74eace8075b99f3) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:21.594202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01cb0f-bec3-4e1a-91a6-7565ee294166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:21.595624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01cb0f-bec3-4e1a-91a6-7565ee294166 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:21.601193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 543/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:21 2022] GET /identity/v3/role_assignments?user.id=b9935d6cdd9c4c56b74eace8075b99f3&scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:23.713504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b254-2b61-4e0b-940b-20ddedad65e5 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:23.714047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b254-2b61-4e0b-940b-20ddedad65e5 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:23.714047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b254-2b61-4e0b-940b-20ddedad65e5 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:23.715383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 575/1118] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:23.720739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f1e58-8b70-4777-9afa-256b46dab31d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:23.721177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f1e58-8b70-4777-9afa-256b46dab31d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:23.721282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f1e58-8b70-4777-9afa-256b46dab31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:23.739502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-516f1e58-8b70-4777-9afa-256b46dab31d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:23.740726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-516f1e58-8b70-4777-9afa-256b46dab31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:23.808894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 544/1119] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:24.077262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7b254-2b61-4e0b-940b-20ddedad65e5 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:24.177200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7b254-2b61-4e0b-940b-20ddedad65e5 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:24.210100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:24.210709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.211037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.211307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] PATH_INFO: `/v3/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.213225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] RBAC: Authorizing `identity:get_role(role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:24.214634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:24.215973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 576/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:24 2022] GET /identity/v3/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:24.221811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f1e58-8b70-4777-9afa-256b46dab31d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:24.255056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:24.318355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f1e58-8b70-4777-9afa-256b46dab31d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:24.351368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:24.351949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.352778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.353048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] PATH_INFO: `/v3/users/b9935d6cdd9c4c56b74eace8075b99f3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.354160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] RBAC: Authorizing `identity:get_user(user_id=b9935d6cdd9c4c56b74eace8075b99f3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:24.355579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:24.357200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 545/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:24 2022] GET /identity/v3/users/b9935d6cdd9c4c56b74eace8075b99f3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:24.362981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:24.378245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:24.461271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8727033-f6f2-42d3-9fbf-ae1bc20622a3 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:24.495106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5f573-2915-4bff-aaa2-f98882dae105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:24.495718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f573-2915-4bff-aaa2-f98882dae105 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.496021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f573-2915-4bff-aaa2-f98882dae105 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.496294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f573-2915-4bff-aaa2-f98882dae105 None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.497394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5f573-2915-4bff-aaa2-f98882dae105 None admin] RBAC: Authorizing `identity:get_project(project_id=055d92ce3cab42aa9703111c0e4bc2c0)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:24.498809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5f573-2915-4bff-aaa2-f98882dae105 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:24.500478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 577/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:24 2022] GET /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:24.506447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:24.604164 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb058a-4453-48e8-89a7-964e8786423d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:24.606395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:24.638700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b215f-d09d-408b-95ac-3c0555dcb632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:24.639350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b215f-d09d-408b-95ac-3c0555dcb632 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.639625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b215f-d09d-408b-95ac-3c0555dcb632 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.639921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b215f-d09d-408b-95ac-3c0555dcb632 None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0/users/b9935d6cdd9c4c56b74eace8075b99f3/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.642038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b215f-d09d-408b-95ac-3c0555dcb632 None admin] RBAC: Authorizing `identity:create_grant(project_id=055d92ce3cab42aa9703111c0e4bc2c0, user_id=b9935d6cdd9c4c56b74eace8075b99f3, role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:24.643465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b215f-d09d-408b-95ac-3c0555dcb632 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:24.656745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 546/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:24 2022] PUT /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0/users/b9935d6cdd9c4c56b74eace8075b99f3/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:13:26.795973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a037b2-5b07-482e-9aae-c2ccfc8c49ad None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.796497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a037b2-5b07-482e-9aae-c2ccfc8c49ad None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.796497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a037b2-5b07-482e-9aae-c2ccfc8c49ad None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.797840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 578/1124] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:26.803360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c52d-a7ab-4af4-8bcc-9aeae73cbe25 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.803742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c52d-a7ab-4af4-8bcc-9aeae73cbe25 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.803932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c52d-a7ab-4af4-8bcc-9aeae73cbe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.823071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-28c1c52d-a7ab-4af4-8bcc-9aeae73cbe25 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:26.824327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-28c1c52d-a7ab-4af4-8bcc-9aeae73cbe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:26.890346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 547/1125] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:27.158551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a037b2-5b07-482e-9aae-c2ccfc8c49ad None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:27.238062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:27.256877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a037b2-5b07-482e-9aae-c2ccfc8c49ad None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:27.290421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:27.291400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:27.291400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:27.291611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] PATH_INFO: `/v3/roles/4a01ae1d01574544a8b36d8461cd2d28` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:27.292980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] RBAC: Authorizing `identity:get_role(role_id=4a01ae1d01574544a8b36d8461cd2d28)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:27.294336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:27.295649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 579/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:27 2022] GET /identity/v3/roles/4a01ae1d01574544a8b36d8461cd2d28 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:27.301592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1c52d-a7ab-4af4-8bcc-9aeae73cbe25 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:27.391695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:27.399150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1c52d-a7ab-4af4-8bcc-9aeae73cbe25 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:27.434226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:27.434838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:27.435110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:27.435375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] PATH_INFO: `/v3/users/b9935d6cdd9c4c56b74eace8075b99f3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:27.436484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] RBAC: Authorizing `identity:get_user(user_id=b9935d6cdd9c4c56b74eace8075b99f3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:27.437904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:27.439484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 548/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:27 2022] GET /identity/v3/users/b9935d6cdd9c4c56b74eace8075b99f3 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:27.445351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:27.542540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90600176-dc37-49ef-ae66-d372bcce71e7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:27.575186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:27.575778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:27.576087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:27.576357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:27.594615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:27.642609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:27.644074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:27.738289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 580/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:13:27.744197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:27.841869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c77c8-0994-4434-bfce-8318a6cd54bb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:27.881271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283e70-03bb-40b3-89ae-08338ca216aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:27.881896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283e70-03bb-40b3-89ae-08338ca216aa None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:27.882175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283e70-03bb-40b3-89ae-08338ca216aa None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:27.882447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283e70-03bb-40b3-89ae-08338ca216aa None admin] PATH_INFO: `/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:27.883563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283e70-03bb-40b3-89ae-08338ca216aa None admin] RBAC: Authorizing `identity:get_project(project_id=055d92ce3cab42aa9703111c0e4bc2c0)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:27.885635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283e70-03bb-40b3-89ae-08338ca216aa None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:27.887281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 549/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:27 2022] GET /identity/v3/projects/055d92ce3cab42aa9703111c0e4bc2c0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:27.894204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:27.943224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:27.992463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a1b4-43c7-4fde-971f-cd755df5c2de None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:28.026086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8031dca-677e-4a92-804d-2a1c3559f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:28.026677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031dca-677e-4a92-804d-2a1c3559f339 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:28.026948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031dca-677e-4a92-804d-2a1c3559f339 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:28.027214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031dca-677e-4a92-804d-2a1c3559f339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:28.027954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031dca-677e-4a92-804d-2a1c3559f339 None admin] RBAC: Adding query filter params (role.id=4a01ae1d01574544a8b36d8461cd2d28, scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0, user.id=b9935d6cdd9c4c56b74eace8075b99f3) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:28.028258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031dca-677e-4a92-804d-2a1c3559f339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:28.029674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031dca-677e-4a92-804d-2a1c3559f339 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:28.035438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 581/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:27 2022] GET /identity/v3/role_assignments?user.id=b9935d6cdd9c4c56b74eace8075b99f3&scope.project.id=055d92ce3cab42aa9703111c0e4bc2c0&role.id=4a01ae1d01574544a8b36d8461cd2d28 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:30.217476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022771d-c309-4c3f-98e3-9d29e8359604 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:30.218053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022771d-c309-4c3f-98e3-9d29e8359604 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:30.218053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022771d-c309-4c3f-98e3-9d29e8359604 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:30.219379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 550/1131] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:30.224687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bb76-3c26-4cc4-9366-753f939988b4 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:30.225096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bb76-3c26-4cc4-9366-753f939988b4 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:30.225206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bb76-3c26-4cc4-9366-753f939988b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:30.244147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-cd84bb76-3c26-4cc4-9366-753f939988b4 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:30.245306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-cd84bb76-3c26-4cc4-9366-753f939988b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:30.309171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 582/1132] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:30.573295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022771d-c309-4c3f-98e3-9d29e8359604 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:30.603483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:30.673945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022771d-c309-4c3f-98e3-9d29e8359604 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:30.706595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224bc78-ec8f-43cd-b304-64ca9d84ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:30.707211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224bc78-ec8f-43cd-b304-64ca9d84ad77 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:30.707489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224bc78-ec8f-43cd-b304-64ca9d84ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:30.707760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224bc78-ec8f-43cd-b304-64ca9d84ad77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:30.708896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224bc78-ec8f-43cd-b304-64ca9d84ad77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:30.710319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224bc78-ec8f-43cd-b304-64ca9d84ad77 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:30.711906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 551/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:30.718257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bb76-3c26-4cc4-9366-753f939988b4 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:30.762155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:30.815481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bb76-3c26-4cc4-9366-753f939988b4 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:30.848995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae29d7-f921-424d-b300-ef8fda1bb5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:30.849535 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae29d7-f921-424d-b300-ef8fda1bb5e9 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:30.849816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae29d7-f921-424d-b300-ef8fda1bb5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:30.850089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae29d7-f921-424d-b300-ef8fda1bb5e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:30.850755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae29d7-f921-424d-b300-ef8fda1bb5e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:30.852383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae29d7-f921-424d-b300-ef8fda1bb5e9 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:30.879775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 583/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:13:30 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:33.040591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82199f4-bc46-4184-944e-da0461539c80 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:33.041648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82199f4-bc46-4184-944e-da0461539c80 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:33.041648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82199f4-bc46-4184-944e-da0461539c80 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:33.042972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 552/1135] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:33.048705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505608de-feb4-4bbe-87b7-ed2d1690d0d5 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:33.049148 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505608de-feb4-4bbe-87b7-ed2d1690d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:33.049253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505608de-feb4-4bbe-87b7-ed2d1690d0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:33.070269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-505608de-feb4-4bbe-87b7-ed2d1690d0d5 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:33.071677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-505608de-feb4-4bbe-87b7-ed2d1690d0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:33.138568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 584/1136] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:13:33.406939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82199f4-bc46-4184-944e-da0461539c80 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:33.508372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:33.513754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82199f4-bc46-4184-944e-da0461539c80 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:33.546519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13905680-1ecf-485c-b2ce-25d7910c25aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:33.547133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905680-1ecf-485c-b2ce-25d7910c25aa None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:33.547409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905680-1ecf-485c-b2ce-25d7910c25aa None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:33.547674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905680-1ecf-485c-b2ce-25d7910c25aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:33.548818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13905680-1ecf-485c-b2ce-25d7910c25aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:33.550239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13905680-1ecf-485c-b2ce-25d7910c25aa None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:33.551819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 553/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:33.557758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505608de-feb4-4bbe-87b7-ed2d1690d0d5 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:33.584410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:33.657074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505608de-feb4-4bbe-87b7-ed2d1690d0d5 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:33.689160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7af188-f3cd-478c-ae7f-679d91762243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:33.689756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7af188-f3cd-478c-ae7f-679d91762243 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:33.690027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7af188-f3cd-478c-ae7f-679d91762243 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:33.690294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7af188-f3cd-478c-ae7f-679d91762243 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:33.690938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7af188-f3cd-478c-ae7f-679d91762243 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:33.692370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7af188-f3cd-478c-ae7f-679d91762243 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:33.714738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 585/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:33 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:35.919545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c645c-fbc2-4d41-92e4-2bd64f936d28 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:35.920088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c645c-fbc2-4d41-92e4-2bd64f936d28 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:35.920175 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c645c-fbc2-4d41-92e4-2bd64f936d28 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:35.921478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 554/1139] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:35.926847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b6d9f-aae1-4c08-b808-7eaf899df145 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:35.927300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b6d9f-aae1-4c08-b808-7eaf899df145 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:35.927395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b6d9f-aae1-4c08-b808-7eaf899df145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:35.945395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-7f0b6d9f-aae1-4c08-b808-7eaf899df145 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:35.946561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7f0b6d9f-aae1-4c08-b808-7eaf899df145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:36.011795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 586/1140] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:36.280752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c645c-fbc2-4d41-92e4-2bd64f936d28 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:36.381729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c645c-fbc2-4d41-92e4-2bd64f936d28 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:36.416885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:36.417517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:36.417796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:36.418070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:36.430301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:36.435983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:36.437212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:36.438061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 555/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:36.444157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b6d9f-aae1-4c08-b808-7eaf899df145 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:36.465408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:36.553748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b6d9f-aae1-4c08-b808-7eaf899df145 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:36.587480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:36.588109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:36.588386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:36.588653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:36.589314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:36.589614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:36.590977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:36.599241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 587/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:36.606384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:36.634577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:36.716486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518eb7-e3e6-4437-9981-0c2472048ff7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:36.754099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:36.754724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:36.755002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:36.755272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] PATH_INFO: `/v3/users/fe2f104b0ccd436bb7238461db31df87` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:36.768418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] RBAC: Authorizing `identity:get_user(user_id=fe2f104b0ccd436bb7238461db31df87)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:36.769975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:36.772419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 556/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:36 2022] GET /identity/v3/users/fe2f104b0ccd436bb7238461db31df87 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:36.779436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:36.867702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:36.892988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b5b9-afa9-403a-8d8d-ad78ddf7514a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:36.927981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:36.928720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:36.928845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:36.929111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.001085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:37.002538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:37.076870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:37.102710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 588/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:13:37.109408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:37.204481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:37.222348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94b9b6-1651-4579-b417-2e798da5aa57 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:37.257577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78c1b-9dee-4786-a6dc-929be465c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:37.258196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78c1b-9dee-4786-a6dc-929be465c286 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.258471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78c1b-9dee-4786-a6dc-929be465c286 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.258740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78c1b-9dee-4786-a6dc-929be465c286 None admin] PATH_INFO: `/v3/projects/3e741c6bdff34178a6ea788f8f10eb19` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.260353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d78c1b-9dee-4786-a6dc-929be465c286 None admin] RBAC: Authorizing `identity:get_project(project_id=3e741c6bdff34178a6ea788f8f10eb19)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:37.261782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d78c1b-9dee-4786-a6dc-929be465c286 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:37.263428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 557/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:37 2022] GET /identity/v3/projects/3e741c6bdff34178a6ea788f8f10eb19 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:37.269777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:37.364903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4571f-5ebf-4c12-a1b0-469bf0d95f12 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:37.397574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346fbec-fbf3-4f02-86e7-fa03c7267198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:37.398166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346fbec-fbf3-4f02-86e7-fa03c7267198 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.398440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346fbec-fbf3-4f02-86e7-fa03c7267198 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.398704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346fbec-fbf3-4f02-86e7-fa03c7267198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.399412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346fbec-fbf3-4f02-86e7-fa03c7267198 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=3e741c6bdff34178a6ea788f8f10eb19, user.id=fe2f104b0ccd436bb7238461db31df87) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:37.399711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346fbec-fbf3-4f02-86e7-fa03c7267198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:37.402006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346fbec-fbf3-4f02-86e7-fa03c7267198 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:37.407210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 589/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:37 2022] GET /identity/v3/role_assignments?user.id=fe2f104b0ccd436bb7238461db31df87&scope.project.id=3e741c6bdff34178a6ea788f8f10eb19&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:39.548387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1741-b756-4f3c-ba75-69cc30547cbb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.548918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1741-b756-4f3c-ba75-69cc30547cbb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.548918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1741-b756-4f3c-ba75-69cc30547cbb None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.550265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 558/1147] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:39.555498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8323088-0788-4675-ab7a-d073f42ccdf8 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.555953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8323088-0788-4675-ab7a-d073f42ccdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.556047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8323088-0788-4675-ab7a-d073f42ccdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.574392 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-f8323088-0788-4675-ab7a-d073f42ccdf8 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:39.575521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-f8323088-0788-4675-ab7a-d073f42ccdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:39.604390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.641558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 590/1148] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:39.907629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1741-b756-4f3c-ba75-69cc30547cbb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.007969 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1741-b756-4f3c-ba75-69cc30547cbb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.041853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.042469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.042744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.043011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.052791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:40.057615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:40.058713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:40.059744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 559/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:40.064811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8323088-0788-4675-ab7a-d073f42ccdf8 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.164622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8323088-0788-4675-ab7a-d073f42ccdf8 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.198829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.199426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.199702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.200000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.200660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:40.200958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.202312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.210283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 591/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:40.216782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.231655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:40.313852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781a487-d414-4c8f-846c-66ee3f3a7a64 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.347694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.348337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.348610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.348872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] PATH_INFO: `/v3/users/fe2f104b0ccd436bb7238461db31df87` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.349974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] RBAC: Authorizing `identity:get_user(user_id=fe2f104b0ccd436bb7238461db31df87)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.351389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.352999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 560/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:40 2022] GET /identity/v3/users/fe2f104b0ccd436bb7238461db31df87 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:40.358809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.389152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:40.457851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d861-618d-4ad0-aca0-ee84a878cdaa None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.496613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5200f-ef44-44fa-bcfa-bdd12e90bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.497247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5200f-ef44-44fa-bcfa-bdd12e90bbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.497526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5200f-ef44-44fa-bcfa-bdd12e90bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.497810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5200f-ef44-44fa-bcfa-bdd12e90bbe4 None admin] PATH_INFO: `/v3/projects/3e741c6bdff34178a6ea788f8f10eb19` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.498926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5200f-ef44-44fa-bcfa-bdd12e90bbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=3e741c6bdff34178a6ea788f8f10eb19)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.500384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5200f-ef44-44fa-bcfa-bdd12e90bbe4 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.502042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 592/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:40 2022] GET /identity/v3/projects/3e741c6bdff34178a6ea788f8f10eb19 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:40.508091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.587296 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:40.606882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905bce7-83d0-4013-b154-2fce92e04130 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.640790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd63b5-d500-457b-9869-c5ffb89a72a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.641441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd63b5-d500-457b-9869-c5ffb89a72a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.641715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd63b5-d500-457b-9869-c5ffb89a72a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.641982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd63b5-d500-457b-9869-c5ffb89a72a9 None admin] PATH_INFO: `/v3/projects/3e741c6bdff34178a6ea788f8f10eb19/users/fe2f104b0ccd436bb7238461db31df87/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.643854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd63b5-d500-457b-9869-c5ffb89a72a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e741c6bdff34178a6ea788f8f10eb19, user_id=fe2f104b0ccd436bb7238461db31df87, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.645271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd63b5-d500-457b-9869-c5ffb89a72a9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.658246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 561/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:40 2022] PUT /identity/v3/projects/3e741c6bdff34178a6ea788f8f10eb19/users/fe2f104b0ccd436bb7238461db31df87/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:13:42.857461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b348-5640-450c-8882-1c0f6f5aa3f9 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:42.858031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b348-5640-450c-8882-1c0f6f5aa3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:42.858031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b348-5640-450c-8882-1c0f6f5aa3f9 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:42.859276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 593/1154] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:42.864570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa34d-582f-4f76-8974-e5ecc17162c8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:42.864968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa34d-582f-4f76-8974-e5ecc17162c8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:42.865112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa34d-582f-4f76-8974-e5ecc17162c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:42.882722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d14fa34d-582f-4f76-8974-e5ecc17162c8 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:42.883933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d14fa34d-582f-4f76-8974-e5ecc17162c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:42.950277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 562/1155] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:43.222490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b348-5640-450c-8882-1c0f6f5aa3f9 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:43.316002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:43.320970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b348-5640-450c-8882-1c0f6f5aa3f9 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:43.356054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:43.356673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.356944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.357235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.368031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:43.372748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:43.373939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:43.375011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 594/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:43.379968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fa34d-582f-4f76-8974-e5ecc17162c8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:43.446551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:43.478479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fa34d-582f-4f76-8974-e5ecc17162c8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:43.513120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:43.513720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.513998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.514332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.514932 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:43.515235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:43.516630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:43.524464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 563/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:43.531149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:43.632092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64905289-cacf-4589-b911-07eb508f3205 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:43.669605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:43.670226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.670506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.670780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] PATH_INFO: `/v3/users/fe2f104b0ccd436bb7238461db31df87` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.671924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] RBAC: Authorizing `identity:get_user(user_id=fe2f104b0ccd436bb7238461db31df87)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:43.673345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:43.674938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 595/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:43 2022] GET /identity/v3/users/fe2f104b0ccd436bb7238461db31df87 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:43.680790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:43.778594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540ffb-a5f2-41c7-8dec-a48ccf98af56 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:43.806715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:43.811926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:43.812521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.812795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.813059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.877005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:43.878431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:43.980160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 564/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:13:43.986194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.013713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.084824 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4486e9e-35d9-44ce-ba41-e4121ea3028f None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.121585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae258247-5001-4606-bc60-aea17075a3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.122639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae258247-5001-4606-bc60-aea17075a3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.122923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae258247-5001-4606-bc60-aea17075a3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.123199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae258247-5001-4606-bc60-aea17075a3e8 None admin] PATH_INFO: `/v3/projects/3e741c6bdff34178a6ea788f8f10eb19` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.125398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae258247-5001-4606-bc60-aea17075a3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=3e741c6bdff34178a6ea788f8f10eb19)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:44.126885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae258247-5001-4606-bc60-aea17075a3e8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:44.128574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 596/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:43 2022] GET /identity/v3/projects/3e741c6bdff34178a6ea788f8f10eb19 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:44.135187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.165197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.236660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b75ab-699b-49b6-9c22-82e9bc13bbef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.270202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257df66-db90-4b26-8fa6-189e1f28c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.270793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257df66-db90-4b26-8fa6-189e1f28c80c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.271071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257df66-db90-4b26-8fa6-189e1f28c80c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.271343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257df66-db90-4b26-8fa6-189e1f28c80c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.272093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257df66-db90-4b26-8fa6-189e1f28c80c None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=3e741c6bdff34178a6ea788f8f10eb19, user.id=fe2f104b0ccd436bb7238461db31df87) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:44.272401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257df66-db90-4b26-8fa6-189e1f28c80c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:44.273822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257df66-db90-4b26-8fa6-189e1f28c80c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:44.279831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 565/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/role_assignments?user.id=fe2f104b0ccd436bb7238461db31df87&scope.project.id=3e741c6bdff34178a6ea788f8f10eb19&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:46.446028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71122-c49d-4da9-8390-db4a4866c135 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.446590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71122-c49d-4da9-8390-db4a4866c135 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.446590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71122-c49d-4da9-8390-db4a4866c135 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.447967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 597/1162] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:46.453112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e1959-c9d4-47a2-a569-d6096db35163 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.453545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e1959-c9d4-47a2-a569-d6096db35163 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.453645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e1959-c9d4-47a2-a569-d6096db35163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.471418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-4a6e1959-c9d4-47a2-a569-d6096db35163 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:46.472639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4a6e1959-c9d4-47a2-a569-d6096db35163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:46.537637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 566/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:46.807568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e71122-c49d-4da9-8390-db4a4866c135 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.898335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:46.907584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e71122-c49d-4da9-8390-db4a4866c135 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.940702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.941303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.941582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.941854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.006483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:47.007940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:47.097455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:47.104926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 598/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:13:47.110856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e1959-c9d4-47a2-a569-d6096db35163 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:47.136853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:47.207176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e1959-c9d4-47a2-a569-d6096db35163 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:47.240163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03da47-6cfb-4e18-a7ac-16f50a55d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:47.240789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03da47-6cfb-4e18-a7ac-16f50a55d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.241071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03da47-6cfb-4e18-a7ac-16f50a55d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.241345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03da47-6cfb-4e18-a7ac-16f50a55d0b6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.248094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03da47-6cfb-4e18-a7ac-16f50a55d0b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:47.249543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03da47-6cfb-4e18-a7ac-16f50a55d0b6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-bd03da47-6cfb-4e18-a7ac-16f50a55d0b6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:47.262086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:47.264904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:13:47.266057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 567/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:13:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:47.269567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:47.366890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee407-ad0c-43ab-91e5-14fa37b4f59b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:47.400650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e303429-61f8-4d7f-9f69-668ee7aec01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:47.401492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303429-61f8-4d7f-9f69-668ee7aec01f None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.401762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303429-61f8-4d7f-9f69-668ee7aec01f None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.402026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303429-61f8-4d7f-9f69-668ee7aec01f None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.402651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e303429-61f8-4d7f-9f69-668ee7aec01f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:47.402948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e303429-61f8-4d7f-9f69-668ee7aec01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:47.404325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e303429-61f8-4d7f-9f69-668ee7aec01f None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:47.411934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 599/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Sep 14 15:13:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:49.575333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d28a-4061-4e76-bcf5-f7287e544cf2 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:49.575923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d28a-4061-4e76-bcf5-f7287e544cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:49.575923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d28a-4061-4e76-bcf5-f7287e544cf2 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:49.577255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 568/1167] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:49.582501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81075883-5b87-493e-bdc9-b8185fa26bb3 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:49.582937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81075883-5b87-493e-bdc9-b8185fa26bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:49.583046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81075883-5b87-493e-bdc9-b8185fa26bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:49.601746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-81075883-5b87-493e-bdc9-b8185fa26bb3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:49.603615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-81075883-5b87-493e-bdc9-b8185fa26bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:49.657955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:49.672162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 600/1168] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:49.943034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44d28a-4061-4e76-bcf5-f7287e544cf2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.028055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:50.044036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44d28a-4061-4e76-bcf5-f7287e544cf2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:50.076514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ab334-695d-4432-88ab-d41a5f14aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:50.077116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ab334-695d-4432-88ab-d41a5f14aa9c None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:50.077389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ab334-695d-4432-88ab-d41a5f14aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:50.077661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ab334-695d-4432-88ab-d41a5f14aa9c None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:50.078324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ab334-695d-4432-88ab-d41a5f14aa9c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:50.079683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ab334-695d-4432-88ab-d41a5f14aa9c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:50.095405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 569/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Wed Sep 14 15:13:49 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:52.265846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27d4d-a1a7-42e6-b81c-72643072a225 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.266411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27d4d-a1a7-42e6-b81c-72643072a225 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.266411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27d4d-a1a7-42e6-b81c-72643072a225 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.267711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 601/1170] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:52.272862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595103-eb12-45a3-ba0e-a245fc48ca6e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.273291 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595103-eb12-45a3-ba0e-a245fc48ca6e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.273395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595103-eb12-45a3-ba0e-a245fc48ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.294552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3b595103-eb12-45a3-ba0e-a245fc48ca6e None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:52.295233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3b595103-eb12-45a3-ba0e-a245fc48ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:52.360008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 570/1171] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:52.624230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27d4d-a1a7-42e6-b81c-72643072a225 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.730471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27d4d-a1a7-42e6-b81c-72643072a225 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:52.762631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a4dea-c266-4b4c-87e2-785e2721e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:52.763245 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a4dea-c266-4b4c-87e2-785e2721e042 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.763522 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a4dea-c266-4b4c-87e2-785e2721e042 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.763791 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a4dea-c266-4b4c-87e2-785e2721e042 None admin] PATH_INFO: `/v3/domains/a2b8424f158d4971910fa4511e43d83b` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.773873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a4dea-c266-4b4c-87e2-785e2721e042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a2b8424f158d4971910fa4511e43d83b)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:52.775837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a4dea-c266-4b4c-87e2-785e2721e042 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:52.777699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 602/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Sep 14 15:13:52 2022] GET /identity/v3/domains/a2b8424f158d4971910fa4511e43d83b => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:52.783518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b595103-eb12-45a3-ba0e-a245fc48ca6e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.856370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:52.879802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b595103-eb12-45a3-ba0e-a245fc48ca6e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:52.915042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149fac4-f5a4-48f7-9d61-79c591002c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:52.916324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fac4-f5a4-48f7-9d61-79c591002c1f None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.916600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fac4-f5a4-48f7-9d61-79c591002c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.916868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fac4-f5a4-48f7-9d61-79c591002c1f None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.917509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149fac4-f5a4-48f7-9d61-79c591002c1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:52.918917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149fac4-f5a4-48f7-9d61-79c591002c1f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:52.944433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 571/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:13:52 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:55.134995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fea78-ff3e-41b7-9f0a-70c5290d20eb None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.135538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fea78-ff3e-41b7-9f0a-70c5290d20eb None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.135538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fea78-ff3e-41b7-9f0a-70c5290d20eb None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.136898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 603/1174] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:55.142074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53761-ed42-4f92-9fe6-9213fd9a4594 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.142451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53761-ed42-4f92-9fe6-9213fd9a4594 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.142632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53761-ed42-4f92-9fe6-9213fd9a4594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.162536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-03b53761-ed42-4f92-9fe6-9213fd9a4594 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:55.163749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-03b53761-ed42-4f92-9fe6-9213fd9a4594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:55.232605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 572/1175] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:55.502783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fea78-ff3e-41b7-9f0a-70c5290d20eb None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.552660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.605581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fea78-ff3e-41b7-9f0a-70c5290d20eb None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.639152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ee91-b40a-4029-bd99-972b50e9bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.639771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ee91-b40a-4029-bd99-972b50e9bb9a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.640073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ee91-b40a-4029-bd99-972b50e9bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.640340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ee91-b40a-4029-bd99-972b50e9bb9a None admin] PATH_INFO: `/v3/domains/a2b8424f158d4971910fa4511e43d83b` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.641445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526ee91-b40a-4029-bd99-972b50e9bb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=a2b8424f158d4971910fa4511e43d83b)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:55.642867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526ee91-b40a-4029-bd99-972b50e9bb9a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:55.644469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 604/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/domains/a2b8424f158d4971910fa4511e43d83b => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:55.650221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53761-ed42-4f92-9fe6-9213fd9a4594 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.706585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.749687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53761-ed42-4f92-9fe6-9213fd9a4594 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.784352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8bc42-97b4-4033-a5a8-6f033215e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.784891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8bc42-97b4-4033-a5a8-6f033215e4c4 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.785170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8bc42-97b4-4033-a5a8-6f033215e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.785436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8bc42-97b4-4033-a5a8-6f033215e4c4 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.786085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8bc42-97b4-4033-a5a8-6f033215e4c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:55.787503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8bc42-97b4-4033-a5a8-6f033215e4c4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:55.808414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 573/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:55 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:58.008642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734985-2680-4494-a16d-acf1cc668ffe None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.009234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734985-2680-4494-a16d-acf1cc668ffe None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.009234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734985-2680-4494-a16d-acf1cc668ffe None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.010685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 605/1178] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:58.016151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c47b7-8cf9-4142-a009-800107fb41c7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.016577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c47b7-8cf9-4142-a009-800107fb41c7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.016691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c47b7-8cf9-4142-a009-800107fb41c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.035277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-288c47b7-8cf9-4142-a009-800107fb41c7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:58.036493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-288c47b7-8cf9-4142-a009-800107fb41c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:58.101377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 574/1179] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:13:58.370310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27734985-2680-4494-a16d-acf1cc668ffe None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:58.471612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27734985-2680-4494-a16d-acf1cc668ffe None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:58.487001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:58.504346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:58.504956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.505226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.505502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.516268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:58.520968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:58.522062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:13:58.523288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 606/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:58.529078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c47b7-8cf9-4142-a009-800107fb41c7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:58.574112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:58.628280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c47b7-8cf9-4142-a009-800107fb41c7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:58.661597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:58.662199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.662479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.662750 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.663413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:58.663713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:58.665131 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:58.672898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 575/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:58.678867 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:58.787181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1023c6d-6201-4480-94e0-aa6c4e23cef8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:58.819323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:58.819966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.820243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.820507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] PATH_INFO: `/v3/users/a6f12e49b6b946f589a8494dd951fa7d` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.833621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] RBAC: Authorizing `identity:get_user(user_id=a6f12e49b6b946f589a8494dd951fa7d)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:58.835044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:58.836672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 607/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:58 2022] GET /identity/v3/users/a6f12e49b6b946f589a8494dd951fa7d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:58.842767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:58.945442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c284-784f-4b61-97bb-a1c414ab0fb1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:58.952660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:58.978826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:58.979417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.979692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.979990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.046216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.047654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:59.141765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 576/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:13:59.147899 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.182362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:59.247426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d854a93-f788-43fc-9a09-6c2f3900fe4a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.280181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c487e-8ffa-4e9c-80cb-f01d0e019205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.280793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c487e-8ffa-4e9c-80cb-f01d0e019205 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.281070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c487e-8ffa-4e9c-80cb-f01d0e019205 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.281341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c487e-8ffa-4e9c-80cb-f01d0e019205 None admin] PATH_INFO: `/v3/projects/747602876bdb47da9722d1e6ec187845` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.282448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c487e-8ffa-4e9c-80cb-f01d0e019205 None admin] RBAC: Authorizing `identity:get_project(project_id=747602876bdb47da9722d1e6ec187845)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.283899 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c487e-8ffa-4e9c-80cb-f01d0e019205 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:59.285552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 608/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:59 2022] GET /identity/v3/projects/747602876bdb47da9722d1e6ec187845 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:59.292244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.300485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:59.391475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17066244-9d4d-4447-9f4c-a79e880bd00c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.424705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4a64b-7ad9-4acf-bd08-66d00ab5cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.425289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4a64b-7ad9-4acf-bd08-66d00ab5cab8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.425563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4a64b-7ad9-4acf-bd08-66d00ab5cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.425829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4a64b-7ad9-4acf-bd08-66d00ab5cab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.426538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4a64b-7ad9-4acf-bd08-66d00ab5cab8 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=747602876bdb47da9722d1e6ec187845, user.id=a6f12e49b6b946f589a8494dd951fa7d) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:59.426838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4a64b-7ad9-4acf-bd08-66d00ab5cab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.428273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4a64b-7ad9-4acf-bd08-66d00ab5cab8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:59.433440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 577/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:59 2022] GET /identity/v3/role_assignments?user.id=a6f12e49b6b946f589a8494dd951fa7d&scope.project.id=747602876bdb47da9722d1e6ec187845&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:01.563667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fecf-9d6f-44b1-990b-e01aadf6747f None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.564248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fecf-9d6f-44b1-990b-e01aadf6747f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.564248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fecf-9d6f-44b1-990b-e01aadf6747f None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.565599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 609/1186] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:01.570860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63de489-5334-46b4-81d0-f7078222da79 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.571328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63de489-5334-46b4-81d0-f7078222da79 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.572037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63de489-5334-46b4-81d0-f7078222da79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.589743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d63de489-5334-46b4-81d0-f7078222da79 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:01.590924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d63de489-5334-46b4-81d0-f7078222da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:01.652050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:01.656814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 578/1187] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:14:01.924460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111fecf-9d6f-44b1-990b-e01aadf6747f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:02.023733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111fecf-9d6f-44b1-990b-e01aadf6747f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:02.025269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:02.058829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:02.059440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.059711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.060008 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.069703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:02.074461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:02.075594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:14:02.076660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 610/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:02.081634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63de489-5334-46b4-81d0-f7078222da79 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:02.179767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63de489-5334-46b4-81d0-f7078222da79 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:02.213899 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:02.214498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.214777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.215051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.215711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:02.216046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:02.217415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:02.225470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 579/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:02.231825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:02.334043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d147366-d80d-4232-9d89-0b778d0c57a7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:02.367334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:02.367970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.368271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.368543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] PATH_INFO: `/v3/users/a6f12e49b6b946f589a8494dd951fa7d` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.369662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] RBAC: Authorizing `identity:get_user(user_id=a6f12e49b6b946f589a8494dd951fa7d)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:02.371087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:02.372679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 611/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:02 2022] GET /identity/v3/users/a6f12e49b6b946f589a8494dd951fa7d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:02.378479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:02.438952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:02.476701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054fd1-6de2-4864-a107-91d5ea9ae176 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:02.508997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421a0b0-0ebf-4967-b911-0d1d823b83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:02.509656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421a0b0-0ebf-4967-b911-0d1d823b83d5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.509934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421a0b0-0ebf-4967-b911-0d1d823b83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.510204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421a0b0-0ebf-4967-b911-0d1d823b83d5 None admin] PATH_INFO: `/v3/projects/747602876bdb47da9722d1e6ec187845` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.511348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421a0b0-0ebf-4967-b911-0d1d823b83d5 None admin] RBAC: Authorizing `identity:get_project(project_id=747602876bdb47da9722d1e6ec187845)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:02.512812 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421a0b0-0ebf-4967-b911-0d1d823b83d5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:02.514468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 580/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:02 2022] GET /identity/v3/projects/747602876bdb47da9722d1e6ec187845 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:02.520643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:02.551518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:02.620589 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cf051-651b-4289-947b-f73ba5a11219 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:02.654479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bb105-5005-4bf3-a2a2-6c6fda6c6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:02.655111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb105-5005-4bf3-a2a2-6c6fda6c6fcc None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.655388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb105-5005-4bf3-a2a2-6c6fda6c6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.655659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb105-5005-4bf3-a2a2-6c6fda6c6fcc None admin] PATH_INFO: `/v3/projects/747602876bdb47da9722d1e6ec187845/users/a6f12e49b6b946f589a8494dd951fa7d/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.657647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bb105-5005-4bf3-a2a2-6c6fda6c6fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=747602876bdb47da9722d1e6ec187845, user_id=a6f12e49b6b946f589a8494dd951fa7d, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:02.659078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bb105-5005-4bf3-a2a2-6c6fda6c6fcc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:02.673907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 612/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:02 2022] PUT /identity/v3/projects/747602876bdb47da9722d1e6ec187845/users/a6f12e49b6b946f589a8494dd951fa7d/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:04.780188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56561b4-be89-49e1-b5cd-823b4b76958d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.780747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56561b4-be89-49e1-b5cd-823b4b76958d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.780747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56561b4-be89-49e1-b5cd-823b4b76958d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.782053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 581/1193] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:04.787512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bba8a-f6ca-4056-81ec-1631e7999724 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.787917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bba8a-f6ca-4056-81ec-1631e7999724 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.788092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bba8a-f6ca-4056-81ec-1631e7999724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.807081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-a57bba8a-f6ca-4056-81ec-1631e7999724 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:04.808295 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-a57bba8a-f6ca-4056-81ec-1631e7999724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:04.872507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 613/1194] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:14:05.141597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56561b4-be89-49e1-b5cd-823b4b76958d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:05.244654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56561b4-be89-49e1-b5cd-823b4b76958d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.271651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:05.278192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.278820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.279104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.279378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.290479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:05.295244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:05.296391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:14:05.297412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 582/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:05.302653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bba8a-f6ca-4056-81ec-1631e7999724 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:05.323851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:05.401075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bba8a-f6ca-4056-81ec-1631e7999724 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.435639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.436269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.436543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.436807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.437460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:05.437758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:05.439108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:05.447041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 614/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:05.453041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:05.554992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227181e-a0dd-493d-a61d-9058c1371dae None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.588273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.588898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.589180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.589455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] PATH_INFO: `/v3/users/a6f12e49b6b946f589a8494dd951fa7d` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.590572 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] RBAC: Authorizing `identity:get_user(user_id=a6f12e49b6b946f589a8494dd951fa7d)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:05.592030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:05.593627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 583/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/users/a6f12e49b6b946f589a8494dd951fa7d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:05.600004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:05.684752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:05.705986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d7492-1bc4-48e9-a9f0-c98867a7a2a2 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.738845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.739443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.739717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.740016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.806362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:05.807788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:05.884845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:05.906110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 615/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 15:14:05.912104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:05.971853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:06.029011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ab750-bd82-469b-8b8d-57d572265237 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.062955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80283389-6115-402a-ad5c-8fbdb476ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.063582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283389-6115-402a-ad5c-8fbdb476ce67 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.063890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283389-6115-402a-ad5c-8fbdb476ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.064166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283389-6115-402a-ad5c-8fbdb476ce67 None admin] PATH_INFO: `/v3/projects/747602876bdb47da9722d1e6ec187845` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.065274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80283389-6115-402a-ad5c-8fbdb476ce67 None admin] RBAC: Authorizing `identity:get_project(project_id=747602876bdb47da9722d1e6ec187845)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:06.066712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80283389-6115-402a-ad5c-8fbdb476ce67 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:06.068391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 584/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/projects/747602876bdb47da9722d1e6ec187845 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:06.075157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.171550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d34c6-b1f3-4c08-9d74-206dc11c21aa None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.204848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff4779-3f62-41db-b671-5a7f235b0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.205461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4779-3f62-41db-b671-5a7f235b0c02 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.205739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4779-3f62-41db-b671-5a7f235b0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.206011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4779-3f62-41db-b671-5a7f235b0c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.206724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff4779-3f62-41db-b671-5a7f235b0c02 None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=747602876bdb47da9722d1e6ec187845, user.id=a6f12e49b6b946f589a8494dd951fa7d) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:06.207030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff4779-3f62-41db-b671-5a7f235b0c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:06.208478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff4779-3f62-41db-b671-5a7f235b0c02 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:06.214094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 616/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:06 2022] GET /identity/v3/role_assignments?user.id=a6f12e49b6b946f589a8494dd951fa7d&scope.project.id=747602876bdb47da9722d1e6ec187845&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:16.058726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=37 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:16.212151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=77 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:02.422439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa580b-245a-4e6d-ac87-889664cdfe4d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.423058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa580b-245a-4e6d-ac87-889664cdfe4d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.423058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa580b-245a-4e6d-ac87-889664cdfe4d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.424543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 585/1201] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:02.431564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d35a5-cf91-4fc9-b4a5-3a7b1a59b685 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.432265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d35a5-cf91-4fc9-b4a5-3a7b1a59b685 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.432265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d35a5-cf91-4fc9-b4a5-3a7b1a59b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.454676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4f6d35a5-cf91-4fc9-b4a5-3a7b1a59b685 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:02.455970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4f6d35a5-cf91-4fc9-b4a5-3a7b1a59b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:02.565184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 617/1202] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:02.876028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa580b-245a-4e6d-ac87-889664cdfe4d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.027048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa580b-245a-4e6d-ac87-889664cdfe4d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.073851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.074577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.074903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.075188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.088779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.090238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:03.107119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:03.108357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:03.109375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:03.109375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:03.109375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:03.113666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 586/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:03.116474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d35a5-cf91-4fc9-b4a5-3a7b1a59b685 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.244838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d35a5-cf91-4fc9-b4a5-3a7b1a59b685 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.295129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:03.308238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60810dc5-9463-49ad-9b33-e924b1d29e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.308929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60810dc5-9463-49ad-9b33-e924b1d29e6a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.309344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60810dc5-9463-49ad-9b33-e924b1d29e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.309669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60810dc5-9463-49ad-9b33-e924b1d29e6a None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.310516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60810dc5-9463-49ad-9b33-e924b1d29e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:03.310921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60810dc5-9463-49ad-9b33-e924b1d29e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.312568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60810dc5-9463-49ad-9b33-e924b1d29e6a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.333789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 618/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:03.336443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.402718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:03.473146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d5f64-edbb-44f1-8e00-648f8dbe1c44 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.514064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068437c-c1f8-4e62-8226-687e63ce4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.514550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068437c-c1f8-4e62-8226-687e63ce4117 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.514813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068437c-c1f8-4e62-8226-687e63ce4117 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.515075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068437c-c1f8-4e62-8226-687e63ce4117 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.515731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068437c-c1f8-4e62-8226-687e63ce4117 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.517196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068437c-c1f8-4e62-8226-687e63ce4117 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.543931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 587/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Sep 14 15:15:03 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:05.932105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7db35-9417-4d1c-a8a2-4647dac9484c None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.932655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7db35-9417-4d1c-a8a2-4647dac9484c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.932655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7db35-9417-4d1c-a8a2-4647dac9484c None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.934186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 619/1206] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:05.940858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424d976-35c3-454e-8327-3ee0ca9ab6cf None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.941419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424d976-35c3-454e-8327-3ee0ca9ab6cf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.942102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424d976-35c3-454e-8327-3ee0ca9ab6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.967943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b424d976-35c3-454e-8327-3ee0ca9ab6cf None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:05.969287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b424d976-35c3-454e-8327-3ee0ca9ab6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:06.055848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 588/1207] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:06.408694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7db35-9417-4d1c-a8a2-4647dac9484c None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.562884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7db35-9417-4d1c-a8a2-4647dac9484c None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.610048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.610684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.610975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.611227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.625711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:06.630941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:06.632547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:06.637023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 620/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:06.639555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424d976-35c3-454e-8327-3ee0ca9ab6cf None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.690143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.765854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424d976-35c3-454e-8327-3ee0ca9ab6cf None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.809070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.809699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.809980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.810250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.810929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:06.811240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:06.812646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:06.823696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 589/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:06.830465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.896165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.961009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcebfc-6564-4e0b-9fe6-2c82ee88efac None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.998951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.999624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.999934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.000309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.012558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.014006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:07.029199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:07.030738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:07.031838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:07.031838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:07.031838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:07.031838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 621/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:07.036543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:07.171724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:07.174434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2f2f-71ba-43b4-bffe-5886a5f712ec None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.218266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.219292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.219569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.220002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.222277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:07.222277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.222526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.243911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 590/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:07.246280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:07.362734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb0d2c-9640-4b0b-95f6-7842f30bc4fc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.364517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:07.404067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.404864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.405246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.405639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.414724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.416284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:07.431006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:07.433337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:07.434545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:07.438963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 622/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:07.439110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:07.556614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d189-8730-443a-99ce-3a55455caf1b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.601335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.602180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.602625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.603052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.604002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:07.604739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.606469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.633475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 591/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Sep 14 15:15:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:07.634782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:07.752722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa83f7-c33f-4d8d-8389-bbc51bec727a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.791546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.792180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.792455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.792721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.825612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:07.882332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.883800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:08.004703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 623/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:15:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:15:08.011314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:08.031179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:08.121268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8ca56-2062-4f6a-bc46-946be98553c9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:08.162943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:08.166947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:08.167273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:08.167507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:08.180624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:08.182111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:08.209066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:08.210226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:08.216665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:08.216665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:08.216665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:08.216665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 592/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:08.216926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:08.300288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:08.345569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad041-5476-423b-81c0-a1ac4e07d448 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:08.384541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:08.385145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:08.385521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:08.385907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:08.386833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:08.387236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:08.388897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:08.403562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 624/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:08.409489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:08.491144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:08.525913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb095-e853-4d29-a336-6aee3a6b5406 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:08.564484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:08.565362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:08.565650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:08.565927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:08.573406 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:08.574861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:08.590362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:08.591537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:08.592650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 593/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:08.599486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:08.730747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cdf09-98b1-4583-afde-234272219818 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:08.755247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:08.768908 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61115c-d874-42df-8192-3e5d90942765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:08.769619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61115c-d874-42df-8192-3e5d90942765 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:08.769893 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61115c-d874-42df-8192-3e5d90942765 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:08.770160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61115c-d874-42df-8192-3e5d90942765 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:08.770847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61115c-d874-42df-8192-3e5d90942765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:08.771146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61115c-d874-42df-8192-3e5d90942765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:08.773193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61115c-d874-42df-8192-3e5d90942765 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:08.786091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 625/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:08.792147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:08.895524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbde89c-ef4a-445a-b428-d702a1cde40c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:08.929321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:08.936024 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008f1f6-8059-49c5-94f0-42836271e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:08.936638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008f1f6-8059-49c5-94f0-42836271e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:08.936914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008f1f6-8059-49c5-94f0-42836271e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:08.937183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008f1f6-8059-49c5-94f0-42836271e3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:08.937919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008f1f6-8059-49c5-94f0-42836271e3b3 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=05057b8842ea4cf88ba987b913308cd9) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:08.938225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008f1f6-8059-49c5-94f0-42836271e3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:08.939655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008f1f6-8059-49c5-94f0-42836271e3b3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:08.947639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 594/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:15:08 2022] GET /identity/v3/role_assignments?user.id=05057b8842ea4cf88ba987b913308cd9&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:11.322623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ffa7-e6fb-4d3a-9667-c899a3394094 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.323297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ffa7-e6fb-4d3a-9667-c899a3394094 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.323297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ffa7-e6fb-4d3a-9667-c899a3394094 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.324645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 626/1220] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:11.330190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f3b1-7059-4e91-989f-d1f741a9bb91 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.330843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f3b1-7059-4e91-989f-d1f741a9bb91 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.330843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f3b1-7059-4e91-989f-d1f741a9bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.351678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0782f3b1-7059-4e91-989f-d1f741a9bb91 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:11.352967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0782f3b1-7059-4e91-989f-d1f741a9bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:11.431559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 595/1221] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:11.721043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ffa7-e6fb-4d3a-9667-c899a3394094 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:11.838087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ffa7-e6fb-4d3a-9667-c899a3394094 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.877674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.878349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.878626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.879028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.892183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:11.898320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:11.899691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:11.901154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 627/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:11.906942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782f3b1-7059-4e91-989f-d1f741a9bb91 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.024169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782f3b1-7059-4e91-989f-d1f741a9bb91 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.049548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:12.063085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.063743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.064093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.064368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.065095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:12.065482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.066924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.079441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 596/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:12.085972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.136280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:12.208979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0ac2-9163-4920-879a-d0d0ea8a1608 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.246325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.246975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.247335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.247519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.259669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.261256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:12.275553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:12.276756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:12.278087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:12.278087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:12.278087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:12.278087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 628/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:12.282963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.387771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f37c-9bd3-4c75-80fa-b93e00544472 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.423930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.424611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.424906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.425158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.425802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:12.426084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.427478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.440361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 597/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:12.446677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.551217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:12.559650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c20fb-6bd5-4144-928f-3dd99ed6790b None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.603771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.603771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.604045 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.604251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.614259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.617214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:12.631069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:12.632319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:12.633448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 629/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:12.638946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.698484 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:12.758554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357050-8bb9-471b-b1e2-9048c31f260c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.795409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.796103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.796418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.796648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.797427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:12.797780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.799231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.818942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 598/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:12.825632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.940818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a56a-f467-4580-adb0-efe08968abdc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.990657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.991619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.992118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.992563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.007657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:13.009019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:13.026630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:13.028146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:13.029249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:13.029249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:13.029249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:13.029249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 630/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:13.034687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:13.149181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54cfab-6599-4c81-b53f-1b0b2687e37e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:13.151672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:13.193580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:13.194968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.195436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.195939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.197185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:13.197548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:13.199314 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:13.220170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 599/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:13.227700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:13.237649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:13.341709 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c95af3-dfc9-406f-8485-342bb3a94771 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:13.377652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:13.378279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.378554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.378827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.387292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:13.389012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:13.402625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:13.403771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:13.404876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 631/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:13.409797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:13.528961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e95e88-bd45-4b1a-bc90-915e6f47a44e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:13.577200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef4488-17d1-4146-8d0d-7657dc1b4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:13.578062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef4488-17d1-4146-8d0d-7657dc1b4b5f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.578416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef4488-17d1-4146-8d0d-7657dc1b4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.578785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef4488-17d1-4146-8d0d-7657dc1b4b5f None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.579779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef4488-17d1-4146-8d0d-7657dc1b4b5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:13.580300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef4488-17d1-4146-8d0d-7657dc1b4b5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:13.582252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef4488-17d1-4146-8d0d-7657dc1b4b5f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:13.599940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 600/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:13.606674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:13.689536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:13.733498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeac237-38df-4e2a-bef3-8ad10a974bdb None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:13.774633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc879d39-44ab-4adf-90d2-2cd4e27e887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:13.775324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc879d39-44ab-4adf-90d2-2cd4e27e887c None admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.775684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc879d39-44ab-4adf-90d2-2cd4e27e887c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.775987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc879d39-44ab-4adf-90d2-2cd4e27e887c None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/05057b8842ea4cf88ba987b913308cd9/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.791481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc879d39-44ab-4adf-90d2-2cd4e27e887c None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=05057b8842ea4cf88ba987b913308cd9, role_id=e5343d2ac4f74aa0ab98b62ee8a0c6dd)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:13.792758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc879d39-44ab-4adf-90d2-2cd4e27e887c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:13.805783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 632/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:15:13 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/05057b8842ea4cf88ba987b913308cd9/roles/e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:15:16.144060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506fe2c-f798-43f8-a4f9-f30cb26661c8 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:16.144697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506fe2c-f798-43f8-a4f9-f30cb26661c8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:16.144697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506fe2c-f798-43f8-a4f9-f30cb26661c8 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:16.146237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 601/1233] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:16.152493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d69a-01dd-4b02-ad8a-e8d96f7fd753 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:16.152963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d69a-01dd-4b02-ad8a-e8d96f7fd753 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:16.153063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d69a-01dd-4b02-ad8a-e8d96f7fd753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:16.172480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-fac0d69a-01dd-4b02-ad8a-e8d96f7fd753 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:16.173705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-fac0d69a-01dd-4b02-ad8a-e8d96f7fd753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:16.256162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 633/1234] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:16.551582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506fe2c-f798-43f8-a4f9-f30cb26661c8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:16.580962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:16.669861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506fe2c-f798-43f8-a4f9-f30cb26661c8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:16.709963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:16.710645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:16.710975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:16.711246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:16.724040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:16.729301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:16.730410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:16.733454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 602/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Sep 14 15:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:16.737015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0d69a-01dd-4b02-ad8a-e8d96f7fd753 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:16.785851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:16.849539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0d69a-01dd-4b02-ad8a-e8d96f7fd753 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:16.890531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:16.891136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:16.891410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:16.891727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:16.892542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] RBAC: Adding query filter params (name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:16.892886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:16.894329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:16.903708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 634/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Sep 14 15:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:16.910168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:17.006046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:17.024724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b89d3-54bb-440a-b9c8-bf854767d5fd None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:17.062133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:17.062822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.063098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.063367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.075509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:17.077094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:17.093251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:17.094457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:17.095382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:17.095382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:17.095382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:17.095382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 603/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:17.102525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:17.210470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a77d-43c6-4d0f-8d2e-adb135d22681 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:17.220464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:17.253140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:17.253895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.254178 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.254449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.255101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:17.255406 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:17.257507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:17.274894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 635/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:17.281866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:17.400874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591a81-5c76-4710-86ab-d1795ada3932 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:17.439624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:17.440285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.440562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.440833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.443721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:17.449060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:17.450935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:17.464679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:17.465739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:17.466768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 604/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:17.472378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:17.586703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cf7b5-6669-4a79-89ec-705b2bdc67ef None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:17.624681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:17.625527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.627073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.627394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.628404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:17.628713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:17.630435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:17.654150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 636/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Sep 14 15:15:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:17.661579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:17.788707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb41d-0b41-479d-86c8-b7f0c3d8cb9d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:17.827200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:17.827843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.828116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.828386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.896117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:17.906463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:17.908230 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.018547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 605/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:15:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:15:18.025356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.058134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:18.145263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6b22-e302-4af1-9b21-efa8f677bb04 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.182275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.182911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.183188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.183458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.196279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.198040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:18.216122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:18.220658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:18.221620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:18.221620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:18.221620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:18.221620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 637/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:18.223220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.331319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:18.337471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc14050-d0b0-4b89-95ca-8f6341fac36b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.372225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.372861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.373112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.373383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.374028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:18.374324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.375695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.390007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 606/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:18.395911 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.481457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:18.508116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6959-023f-4447-be99-cd84cc05435a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.546327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.546914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.547220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.547555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.555048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.556630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:18.568467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:18.569600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:18.570635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 638/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:18.575761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.695087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632af19-5276-4d1f-9bf0-cfabdd992ad7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.733020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260832c-469c-4e6c-861d-168a33809eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.733603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260832c-469c-4e6c-861d-168a33809eaf None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.733910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260832c-469c-4e6c-861d-168a33809eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.734173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260832c-469c-4e6c-861d-168a33809eaf None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.734974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260832c-469c-4e6c-861d-168a33809eaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:18.735293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260832c-469c-4e6c-861d-168a33809eaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.736845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260832c-469c-4e6c-861d-168a33809eaf None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.759345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 607/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:18.760457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.879055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd9ab5-2837-4a79-9847-0005a13f40a7 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.918077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5889-833b-4d18-801f-7f0d29a795c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.918732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5889-833b-4d18-801f-7f0d29a795c4 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.919013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5889-833b-4d18-801f-7f0d29a795c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.919344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5889-833b-4d18-801f-7f0d29a795c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.920138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5889-833b-4d18-801f-7f0d29a795c4 None admin] RBAC: Adding query filter params (role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=05057b8842ea4cf88ba987b913308cd9) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:18.920521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5889-833b-4d18-801f-7f0d29a795c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.922038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5889-833b-4d18-801f-7f0d29a795c4 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.928271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 639/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/role_assignments?user.id=05057b8842ea4cf88ba987b913308cd9&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=e5343d2ac4f74aa0ab98b62ee8a0c6dd => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:21.351263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca71e-7e35-49a0-a4b0-9ec67c559549 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:21.351894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca71e-7e35-49a0-a4b0-9ec67c559549 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:21.351894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca71e-7e35-49a0-a4b0-9ec67c559549 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:21.353383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 608/1247] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:21.359450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d8b93-c581-471d-8582-8a2a317cd09d None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:21.360143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d8b93-c581-471d-8582-8a2a317cd09d None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:21.360143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d8b93-c581-471d-8582-8a2a317cd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:21.367060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:21.380591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-dc1d8b93-c581-471d-8582-8a2a317cd09d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:21.381826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-dc1d8b93-c581-471d-8582-8a2a317cd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:21.454866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 640/1248] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:21.740704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ca71e-7e35-49a0-a4b0-9ec67c559549 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:21.760220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:21.849272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ca71e-7e35-49a0-a4b0-9ec67c559549 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:21.884458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:21.885103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:21.885388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:21.885667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:21.896883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:21.902335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:21.904052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:21.905338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 609/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:21.910064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d8b93-c581-471d-8582-8a2a317cd09d None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.040367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d8b93-c581-471d-8582-8a2a317cd09d None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.077315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:22.083107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df994-1795-4650-a481-47764f8940dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.083716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df994-1795-4650-a481-47764f8940dc None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.084062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df994-1795-4650-a481-47764f8940dc None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.084303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df994-1795-4650-a481-47764f8940dc None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.084998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df994-1795-4650-a481-47764f8940dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:22.085292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df994-1795-4650-a481-47764f8940dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.086652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df994-1795-4650-a481-47764f8940dc None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.095851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 641/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:22.101588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.199578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:22.227319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ee732-94c5-4f8d-85fd-7d2df536ba0d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.270074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.270753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.271038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.271487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.284339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.286082 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:22.307436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:22.308601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:22.314481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:22.314481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:22.314481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:22.314481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 610/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:22.314776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df994-1795-4650-a481-47764f8940dc None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.425884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df994-1795-4650-a481-47764f8940dc None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.463688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.464361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.464637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.464903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.465558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:22.465854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.467343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.481687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 642/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:22.487529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.596318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a16542-cef0-4862-b30d-81fc31e2a91a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.628541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:22.637507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.638162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.638440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.638713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.647751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.649283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:22.661972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:22.663779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:22.665365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 611/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:22.669770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.729273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:22.777492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5251-feee-4077-80c2-0bdc6ee1dd99 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.814462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.815084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.815359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.815632 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.816466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:22.816768 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.818239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.842712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 643/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:22.844091 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.952434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de939a9-0e18-4dfa-bcbc-cb8fd4c33ab6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.987972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.988598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.988874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.989145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.047117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:23.059997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.061449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.161020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 612/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:15:23.166829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:23.279100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff12026-cebe-4b1b-a6a5-53ce7d020525 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:23.291985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:23.313135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:23.313765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:23.314060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:23.314312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.324817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.326248 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:23.348220 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:23.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:23.350584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:23.350584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:23.350584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:23.350584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 644/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:23.356683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:23.442751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:23.455206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee68c3-e040-4559-83cd-1358d8edd7f8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:23.487380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:23.488007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:23.488567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:23.488567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.489145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:23.489438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.491292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.502021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 613/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:23.508483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:23.606210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480eb4-329b-490f-9b16-4b699bb5ba9e None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:23.640427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:23.641049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:23.641325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:23.641593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.648137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.649569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:23.662208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:23.663297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:23.664555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 645/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:23.669301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:23.776855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a06ae-8b44-4b4f-abf0-46f848ceb4c9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:23.810108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f97c56-f1a2-49fe-bb2f-54bb1700e7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:23.810702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f97c56-f1a2-49fe-bb2f-54bb1700e7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:23.810978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f97c56-f1a2-49fe-bb2f-54bb1700e7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:23.811244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f97c56-f1a2-49fe-bb2f-54bb1700e7a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.811958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f97c56-f1a2-49fe-bb2f-54bb1700e7a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:23.812263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f97c56-f1a2-49fe-bb2f-54bb1700e7a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.813677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f97c56-f1a2-49fe-bb2f-54bb1700e7a7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.825247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 614/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:23.831308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:23.857088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:23.931325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112410f9-4da3-4f30-8473-10acfb5dc5da None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:23.963181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715bd87-ccd0-49e7-8aa2-8113cf7d879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:23.963762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715bd87-ccd0-49e7-8aa2-8113cf7d879b None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:23.964065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715bd87-ccd0-49e7-8aa2-8113cf7d879b None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:23.964334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715bd87-ccd0-49e7-8aa2-8113cf7d879b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.965048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715bd87-ccd0-49e7-8aa2-8113cf7d879b None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=05057b8842ea4cf88ba987b913308cd9) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:23.965350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715bd87-ccd0-49e7-8aa2-8113cf7d879b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.966760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715bd87-ccd0-49e7-8aa2-8113cf7d879b None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.972037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 646/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:15:23 2022] GET /identity/v3/role_assignments?user.id=05057b8842ea4cf88ba987b913308cd9&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:26.116574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd102b2-fc6b-4fe1-9412-b1c54e399aa7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.117110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd102b2-fc6b-4fe1-9412-b1c54e399aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.117110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd102b2-fc6b-4fe1-9412-b1c54e399aa7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.118475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 615/1261] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:26.123889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfedb-ffc0-4d27-8728-0b5343f28d81 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.124353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfedb-ffc0-4d27-8728-0b5343f28d81 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.124477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfedb-ffc0-4d27-8728-0b5343f28d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.143233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-d17bfedb-ffc0-4d27-8728-0b5343f28d81 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:26.144464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-d17bfedb-ffc0-4d27-8728-0b5343f28d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:26.213234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 647/1262] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:26.497604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd102b2-fc6b-4fe1-9412-b1c54e399aa7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:26.509078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:26.596696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd102b2-fc6b-4fe1-9412-b1c54e399aa7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:26.632843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:26.633463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.633737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.634002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.643777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:26.648712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:26.649797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:26.650855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 616/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:26.656202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfedb-ffc0-4d27-8728-0b5343f28d81 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:26.676697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:26.756359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfedb-ffc0-4d27-8728-0b5343f28d81 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:26.789498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:26.790094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.790370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.790640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.791305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:26.791605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:26.792993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:26.800863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 648/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:26.807343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:26.872107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:26.907719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb079c-dc0f-4b4b-82db-d88ea54761c7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:26.941732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:26.942356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.942634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.942904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.952944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:26.954395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:26.968630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:26.969732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:26.971013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:26.971013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:26.971013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:26.971013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 617/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:26.977979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:27.059449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:27.078118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437dfe-f17a-4b43-8f81-6d89618810c6 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:27.111195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:27.111790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.112099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.112370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.113001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:27.113301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:27.114648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:27.126165 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 649/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:27.131948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:27.260129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19972-a4fa-4603-93d1-25e55dbdc8dd None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:27.279857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:27.294120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:27.294736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.295016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.295281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.302618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:27.304105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:27.315158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:27.316317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:27.317519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 618/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:27.322254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:27.420182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a256-37da-40c5-be8e-2fa68cd32cd5 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:27.453764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:27.454363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.454635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.454900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.455618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:27.455940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:27.457341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:27.466453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:27.475623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 650/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Sep 14 15:15:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:27.481453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:27.579631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292d14-c459-45c0-8494-c0865f209848 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:27.613579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:27.614209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.614488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.614766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.625315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:27.626766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:27.641104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:27.642228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:27.643297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:27.643297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:27.643297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:27.643297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 619/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:27.648545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:27.745255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febb836-8fee-4853-ba81-8d7c83b264aa None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:27.779123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:27.779715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.780020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.780290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.780920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:27.781218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:27.782566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:27.793584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 651/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:27.799306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:27.831068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:27.898478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5b4e-265b-45e1-aa43-d4102e7aa0f3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:27.932053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:27.932671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.932951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.933224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.939595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:27.941061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:27.952647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:27.953691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:27.954951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 620/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:27.959626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:28.017170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:28.058301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8514d-e336-49ce-ad26-10f0d755d461 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:28.091880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e72c0d-21a7-43ce-b24d-481bf289bcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:28.092412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72c0d-21a7-43ce-b24d-481bf289bcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:28.092688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72c0d-21a7-43ce-b24d-481bf289bcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:28.092953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72c0d-21a7-43ce-b24d-481bf289bcc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:28.093638 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72c0d-21a7-43ce-b24d-481bf289bcc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:28.093945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72c0d-21a7-43ce-b24d-481bf289bcc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:28.095354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72c0d-21a7-43ce-b24d-481bf289bcc1 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:28.107033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 652/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:28.113058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:28.202104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:28.212937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21db9e-5ad2-49ec-a8a9-f7c48e3cc84f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:28.248222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3e41f-54a4-4d36-988e-9458cf2ab64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:28.248884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e41f-54a4-4d36-988e-9458cf2ab64f None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:28.249159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e41f-54a4-4d36-988e-9458cf2ab64f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:28.249426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e41f-54a4-4d36-988e-9458cf2ab64f None admin] PATH_INFO: `/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/05057b8842ea4cf88ba987b913308cd9/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:28.251298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3e41f-54a4-4d36-988e-9458cf2ab64f None admin] RBAC: Authorizing `identity:create_grant(project_id=f7029d85fe9f4a3194e1873062103d37, user_id=05057b8842ea4cf88ba987b913308cd9, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:28.252759 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3e41f-54a4-4d36-988e-9458cf2ab64f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:28.264877 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 621/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Sep 14 15:15:28 2022] PUT /identity/v3/projects/f7029d85fe9f4a3194e1873062103d37/users/05057b8842ea4cf88ba987b913308cd9/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:15:30.391050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd4f1c-a6ce-447c-92b7-895b70508a0a None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:30.391579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd4f1c-a6ce-447c-92b7-895b70508a0a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:30.391579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd4f1c-a6ce-447c-92b7-895b70508a0a None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:30.392954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 653/1274] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:30.398803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026206-b01c-43aa-afb9-2bb5847bb49a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:30.399222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026206-b01c-43aa-afb9-2bb5847bb49a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:30.399371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026206-b01c-43aa-afb9-2bb5847bb49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:30.418641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fd026206-b01c-43aa-afb9-2bb5847bb49a None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:30.419834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fd026206-b01c-43aa-afb9-2bb5847bb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:30.484417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 622/1275] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:15:30.748871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd4f1c-a6ce-447c-92b7-895b70508a0a None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:30.849634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd4f1c-a6ce-447c-92b7-895b70508a0a None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:30.866915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:30.884726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:30.885345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:30.885620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:30.885889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:30.895702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:30.900566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:30.901622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:30.902811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 654/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Sep 14 15:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:30.909378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd026206-b01c-43aa-afb9-2bb5847bb49a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:30.990358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:31.011691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd026206-b01c-43aa-afb9-2bb5847bb49a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.044807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.045904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.045904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.045904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.046574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:31.046873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.048257 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:31.056594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 623/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Sep 14 15:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:31.062609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.161334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc583e3-21ec-45f0-a751-96079bfa4381 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.194958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.195570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.195866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.196139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.206758 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.208267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:31.224593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:31.230546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:31.231462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:31.231462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:31.231462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:31.231462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 655/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:31.232888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.343697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e9239-1659-4a3a-9f26-8e9a82438ef1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.380976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.381600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.381881 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.382154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.383201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:31.383201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.384473 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:31.395835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 624/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:31.401774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.434714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:31.504417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b7d38-15ac-46ba-8d7a-2348b8464237 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.536820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.538308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.538592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.538863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.546097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.547518 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:31.558957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:31.560066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:31.561263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 656/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:31.565923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.569702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:31.665429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756203d-3c8c-42b7-b387-c970fd0f52fa None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.698107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.698706 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.698986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.699253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.700012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:31.700320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.701734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:31.718802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 625/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Sep 14 15:15:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:31.724628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.818832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:31.828787 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9041744-9890-4341-9823-2016b436fc3a None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.862412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.862939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.863216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.863486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.929623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.931054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.019357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:32.031294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 657/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Sep 14 15:15:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:15:32.037156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:32.096902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:32.135016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80554cc-0e77-42ec-9f85-4a2283fa1a5c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:32.169411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:32.170037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.170313 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.170582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.180552 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:32.181995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:32.196846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:32.197973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:32.199156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:32.199156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:32.199156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:32.199156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 626/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:32.204210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:32.301180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651378d-5451-4404-95a4-725a42d915ed None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:32.334972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:32.335560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.335852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.336124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.336746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:32.337046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:32.338389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.349205 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 658/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:32.354947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:32.453730 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13dd63-01a7-4bdb-a5da-69b6d3ff0d7f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:32.466913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:32.486804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:32.487425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.487704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.488007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.494887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:32.496363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:32.507891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:32.508927 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: ERROR keystone.server.flask.application Sep 14 15:15:32.510158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 627/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:32.515083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:32.563833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:32.612930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0997a8-cf33-410c-8704-978f4b2d81f8 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:32.646132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c21c-0f8a-4902-b6ea-5236bb634545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:32.646721 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c21c-0f8a-4902-b6ea-5236bb634545 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.647022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c21c-0f8a-4902-b6ea-5236bb634545 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.647288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c21c-0f8a-4902-b6ea-5236bb634545 None admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.647990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c21c-0f8a-4902-b6ea-5236bb634545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:32.648286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c21c-0f8a-4902-b6ea-5236bb634545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:32.649678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c21c-0f8a-4902-b6ea-5236bb634545 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.662049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 659/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:32.668366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:32.767092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56b40-f194-4add-b2a8-64ee4b3215f7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:32.799963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171aafc-155d-4704-b84b-7c5fda09327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:32.800556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171aafc-155d-4704-b84b-7c5fda09327d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.800833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171aafc-155d-4704-b84b-7c5fda09327d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.801099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171aafc-155d-4704-b84b-7c5fda09327d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.801818 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171aafc-155d-4704-b84b-7c5fda09327d None admin] RBAC: Adding query filter params (role.id=a21b0e5a21b74ed488e8178b7c0b2696, scope.project.id=f7029d85fe9f4a3194e1873062103d37, user.id=05057b8842ea4cf88ba987b913308cd9) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:32.802120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171aafc-155d-4704-b84b-7c5fda09327d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:32.804156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171aafc-155d-4704-b84b-7c5fda09327d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.809732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 628/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Sep 14 15:15:32 2022] GET /identity/v3/role_assignments?user.id=05057b8842ea4cf88ba987b913308cd9&scope.project.id=f7029d85fe9f4a3194e1873062103d37&role.id=a21b0e5a21b74ed488e8178b7c0b2696 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:35.008436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749518bc-421e-4eec-b044-537cdca1a1f9 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.008975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749518bc-421e-4eec-b044-537cdca1a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.008975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749518bc-421e-4eec-b044-537cdca1a1f9 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.010332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 660/1288] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:35.015566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cd9bd-893a-4acb-91c6-fedbc4870688 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.016093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cd9bd-893a-4acb-91c6-fedbc4870688 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.016197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cd9bd-893a-4acb-91c6-fedbc4870688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.034399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d97cd9bd-893a-4acb-91c6-fedbc4870688 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:35.035602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d97cd9bd-893a-4acb-91c6-fedbc4870688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:35.068353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:35.105822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 629/1289] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:35.387455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749518bc-421e-4eec-b044-537cdca1a1f9 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.488339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749518bc-421e-4eec-b044-537cdca1a1f9 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:35.501475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:35.528712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:35.529822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.530311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.530747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.531922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:35.534596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:35.545101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:35.546468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:35.547477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 661/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:15:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:35.552463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cd9bd-893a-4acb-91c6-fedbc4870688 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.655511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cd9bd-893a-4acb-91c6-fedbc4870688 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:35.689398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc55b7-7279-4d29-9b02-86707e97e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:35.690013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc55b7-7279-4d29-9b02-86707e97e959 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.690293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc55b7-7279-4d29-9b02-86707e97e959 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.690566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc55b7-7279-4d29-9b02-86707e97e959 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.691199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc55b7-7279-4d29-9b02-86707e97e959 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:35.691501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc55b7-7279-4d29-9b02-86707e97e959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:35.692905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc55b7-7279-4d29-9b02-86707e97e959 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:35.698591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 630/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Sep 14 15:15:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:35.704411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.803780 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb102-b1c9-4055-b696-d24bcb8aaaef None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:35.836696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367bffa-7a04-4f6f-861f-b04113394167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:35.837286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367bffa-7a04-4f6f-861f-b04113394167 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.837558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367bffa-7a04-4f6f-861f-b04113394167 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.837821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367bffa-7a04-4f6f-861f-b04113394167 None admin] PATH_INFO: `/v3/services` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.838433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367bffa-7a04-4f6f-861f-b04113394167 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:35.838729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367bffa-7a04-4f6f-861f-b04113394167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:35.840101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367bffa-7a04-4f6f-861f-b04113394167 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:35.844367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 662/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Sep 14 15:15:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:38.009459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07315ce4-4386-451c-8910-8bf96c4f3149 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:38.009994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07315ce4-4386-451c-8910-8bf96c4f3149 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:38.009994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07315ce4-4386-451c-8910-8bf96c4f3149 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:38.011310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 631/1293] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:38.016661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a11f-94fa-409c-9c8b-d1a271058361 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:38.017336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a11f-94fa-409c-9c8b-d1a271058361 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:38.017336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a11f-94fa-409c-9c8b-d1a271058361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:38.036177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-2b27a11f-94fa-409c-9c8b-d1a271058361 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:38.037375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-2b27a11f-94fa-409c-9c8b-d1a271058361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:38.066239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:38.107152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 663/1294] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:38.382634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07315ce4-4386-451c-8910-8bf96c4f3149 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:38.413367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:38.483192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07315ce4-4386-451c-8910-8bf96c4f3149 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:38.516880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5847d65-7c33-4898-aae5-f9cb4520d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:38.517469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847d65-7c33-4898-aae5-f9cb4520d302 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:38.517744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847d65-7c33-4898-aae5-f9cb4520d302 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:38.518011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847d65-7c33-4898-aae5-f9cb4520d302 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:38.518652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5847d65-7c33-4898-aae5-f9cb4520d302 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:38.520011 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5847d65-7c33-4898-aae5-f9cb4520d302 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:38.534336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 632/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Sep 14 15:15:38 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:40.701294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc180d-b448-42e9-9bcb-c9c48311ee8b None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:40.701842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc180d-b448-42e9-9bcb-c9c48311ee8b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:40.701842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc180d-b448-42e9-9bcb-c9c48311ee8b None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:40.703219 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 664/1296] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:40.708482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96bbb-ea27-4883-a85a-a0043cfd69d3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:40.708903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96bbb-ea27-4883-a85a-a0043cfd69d3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:40.709524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96bbb-ea27-4883-a85a-a0043cfd69d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:40.728098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c0b96bbb-ea27-4883-a85a-a0043cfd69d3 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:40.730068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c0b96bbb-ea27-4883-a85a-a0043cfd69d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:40.816186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 633/1297] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:41.087238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc180d-b448-42e9-9bcb-c9c48311ee8b None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:41.185456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc180d-b448-42e9-9bcb-c9c48311ee8b None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:41.221961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:41.222670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:41.223056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:41.223349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:41.224024 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:41.225829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:41.236502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:41.237733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:41.238729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 665/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:15:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:41.244471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96bbb-ea27-4883-a85a-a0043cfd69d3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:41.264475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:41.349409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96bbb-ea27-4883-a85a-a0043cfd69d3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:41.383575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:41.384202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:41.384483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:41.384753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:41.385379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:41.385682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:41.387041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:41.392039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 634/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Sep 14 15:15:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:41.398212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:41.431487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:41.500897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7e745-0fae-4cbb-b5a9-83902ba57a08 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:41.534421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473745d-c21e-4cc8-8484-198bf868a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:41.535013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473745d-c21e-4cc8-8484-198bf868a37c None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:41.535293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473745d-c21e-4cc8-8484-198bf868a37c None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:41.535565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473745d-c21e-4cc8-8484-198bf868a37c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:41.536286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473745d-c21e-4cc8-8484-198bf868a37c None admin] RBAC: Adding query filter params (interface=public, service_id=042e8a55a113405690daeade9513087a, region_id=RegionOne) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:41.536595 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473745d-c21e-4cc8-8484-198bf868a37c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:41.537951 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473745d-c21e-4cc8-8484-198bf868a37c None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:41.542848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 666/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Sep 14 15:15:41 2022] GET /identity/v3/endpoints?service_id=042e8a55a113405690daeade9513087a&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:41.548670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:41.630059 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:41.648829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b885017-83e0-4d16-8b6d-00a685bd10bf None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:41.682043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43439575-43cb-4c5e-8173-08921345d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:41.682640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43439575-43cb-4c5e-8173-08921345d23e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:41.682916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43439575-43cb-4c5e-8173-08921345d23e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:41.683185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43439575-43cb-4c5e-8173-08921345d23e None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:41.683923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43439575-43cb-4c5e-8173-08921345d23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:41.685169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43439575-43cb-4c5e-8173-08921345d23e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:41.691831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 635/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Sep 14 15:15:41 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:15:43.815491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bda514-ffdb-4c60-99d4-c049c0dd13bd None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:43.816080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bda514-ffdb-4c60-99d4-c049c0dd13bd None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:43.816080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bda514-ffdb-4c60-99d4-c049c0dd13bd None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:43.817391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 667/1302] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:43.822570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bc39d-ef54-4aa2-afb8-258a3475a59f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:43.823017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bc39d-ef54-4aa2-afb8-258a3475a59f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:43.823110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bc39d-ef54-4aa2-afb8-258a3475a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:43.841407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d48bc39d-ef54-4aa2-afb8-258a3475a59f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:43.842598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d48bc39d-ef54-4aa2-afb8-258a3475a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:43.909429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 636/1303] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:44.175362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bda514-ffdb-4c60-99d4-c049c0dd13bd None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:44.276188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:44.283959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bda514-ffdb-4c60-99d4-c049c0dd13bd None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:44.316886 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:44.317502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:44.317777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:44.318043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:44.319268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:44.320655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:44.329304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:44.330464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: ERROR keystone.server.flask.application Sep 14 15:15:44.331664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 668/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Sep 14 15:15:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:44.336463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bc39d-ef54-4aa2-afb8-258a3475a59f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:44.410145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:44.433647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bc39d-ef54-4aa2-afb8-258a3475a59f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:44.467593 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbabdb-6fd9-4f8d-b438-99e49d48b9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:44.468221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbabdb-6fd9-4f8d-b438-99e49d48b9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:44.468503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbabdb-6fd9-4f8d-b438-99e49d48b9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:44.468776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbabdb-6fd9-4f8d-b438-99e49d48b9d6 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:44.469413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbabdb-6fd9-4f8d-b438-99e49d48b9d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:44.469716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbabdb-6fd9-4f8d-b438-99e49d48b9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:44.471075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbabdb-6fd9-4f8d-b438-99e49d48b9d6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:44.476123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 637/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Sep 14 15:15:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:44.481962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:44.578383 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df1315-c6f3-42a7-92cf-1be9d3038529 None admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:44.610784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957b324-d661-4f95-8193-41eb79f2e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:44.611420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b324-d661-4f95-8193-41eb79f2e8a2 None admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:44.611651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b324-d661-4f95-8193-41eb79f2e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:44.611953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b324-d661-4f95-8193-41eb79f2e8a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:44.612612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957b324-d661-4f95-8193-41eb79f2e8a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:44.613966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957b324-d661-4f95-8193-41eb79f2e8a2 None admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:44.634025 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 669/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:15:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:54.473160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=30 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:54.629123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:49.329633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178c47-7ab5-4c1e-b3fd-16712071f283 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.331801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178c47-7ab5-4c1e-b3fd-16712071f283 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.333112 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178c47-7ab5-4c1e-b3fd-16712071f283 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.335664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 638/1307] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:16:49 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:49.340747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb021598-30ef-4205-a0c5-feaa1ab63cb8 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.341277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb021598-30ef-4205-a0c5-feaa1ab63cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.341277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb021598-30ef-4205-a0c5-feaa1ab63cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.462056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-eb021598-30ef-4205-a0c5-feaa1ab63cb8 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:49.464005 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-eb021598-30ef-4205-a0c5-feaa1ab63cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:49.618342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 670/1308] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:16:49.922733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133130-bed7-4cc6-b108-48ebc6d206f0 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.923275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133130-bed7-4cc6-b108-48ebc6d206f0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.923700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133130-bed7-4cc6-b108-48ebc6d206f0 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.925630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 639/1309] 10.222.0.65 () {54 vars in 965 bytes} [Wed Sep 14 15:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:49.933990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dfdb7-bb1c-495e-9c44-b62ff4c0550a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.934302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dfdb7-bb1c-495e-9c44-b62ff4c0550a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.934691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dfdb7-bb1c-495e-9c44-b62ff4c0550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:50.032158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-f22dfdb7-bb1c-495e-9c44-b62ff4c0550a None None] MFA Rules not processed for user `317574f1c46a45d9b600329f73a993f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:50.033359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-f22dfdb7-bb1c-495e-9c44-b62ff4c0550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:50.061530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:50.125672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 671/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Sep 14 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:16:50.135105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133130-bed7-4cc6-b108-48ebc6d206f0 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:50.136986 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-17133130-bed7-4cc6-b108-48ebc6d206f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:50.251754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133130-bed7-4cc6-b108-48ebc6d206f0 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:50.330615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0cbc6-c11d-40b0-a29b-4f0da2cc9613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:50.331306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0cbc6-c11d-40b0-a29b-4f0da2cc9613 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:50.331540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0cbc6-c11d-40b0-a29b-4f0da2cc9613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:50.331757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0cbc6-c11d-40b0-a29b-4f0da2cc9613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:50.333936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e1a0cbc6-c11d-40b0-a29b-4f0da2cc9613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:50.393050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:50.459849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0cbc6-c11d-40b0-a29b-4f0da2cc9613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:50.461331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0cbc6-c11d-40b0-a29b-4f0da2cc9613 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:50.483832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 640/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:16:52.937405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705d371-7304-4706-b750-74eb8ed37b47 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:52.937933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705d371-7304-4706-b750-74eb8ed37b47 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:52.937933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705d371-7304-4706-b750-74eb8ed37b47 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:52.939301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 672/1312] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:52.945140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f877-3474-4394-9899-7461bb366a6f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:52.945579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f877-3474-4394-9899-7461bb366a6f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:52.945674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f877-3474-4394-9899-7461bb366a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.018922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b8e2f877-3474-4394-9899-7461bb366a6f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:53.020233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b8e2f877-3474-4394-9899-7461bb366a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:53.120111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 641/1313] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:16:53.401398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705d371-7304-4706-b750-74eb8ed37b47 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:53.403196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-0705d371-7304-4706-b750-74eb8ed37b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:53.508798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705d371-7304-4706-b750-74eb8ed37b47 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:53.581713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:53.584859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551feca7-6cb1-4177-bc63-8d4143674ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:53.585731 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551feca7-6cb1-4177-bc63-8d4143674ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:53.586281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551feca7-6cb1-4177-bc63-8d4143674ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:53.586880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551feca7-6cb1-4177-bc63-8d4143674ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.588533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-551feca7-6cb1-4177-bc63-8d4143674ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:53.704097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551feca7-6cb1-4177-bc63-8d4143674ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:53.705531 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551feca7-6cb1-4177-bc63-8d4143674ec8 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:53.726414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 673/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:16:56.243155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eced2-8904-4b5a-9f98-95d5ade26a71 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:56.243155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eced2-8904-4b5a-9f98-95d5ade26a71 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:56.243155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eced2-8904-4b5a-9f98-95d5ade26a71 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:56.244324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 642/1315] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:56.250913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ade35-db85-4561-b671-5612c77281cd None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:56.251371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ade35-db85-4561-b671-5612c77281cd None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:56.251480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ade35-db85-4561-b671-5612c77281cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:56.320382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-f60ade35-db85-4561-b671-5612c77281cd None None] MFA Rules not processed for user `fc80b9647e8c4c9fbc6e77f46f564e89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:56.321588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-f60ade35-db85-4561-b671-5612c77281cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:56.373814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:56.418434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 674/1316] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:16:56.702622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eced2-8904-4b5a-9f98-95d5ade26a71 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:56.704224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-692eced2-8904-4b5a-9f98-95d5ade26a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:56.714079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:56.807914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eced2-8904-4b5a-9f98-95d5ade26a71 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:56.879792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc679d-2f73-409c-9261-81a8cfdce64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:56.880350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc679d-2f73-409c-9261-81a8cfdce64e service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:56.880623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc679d-2f73-409c-9261-81a8cfdce64e service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:56.880890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc679d-2f73-409c-9261-81a8cfdce64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:56.882486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3ffc679d-2f73-409c-9261-81a8cfdce64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:56.954029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:57.003699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc679d-2f73-409c-9261-81a8cfdce64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:57.005176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc679d-2f73-409c-9261-81a8cfdce64e service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:57.023490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 643/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:16:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:16:59.720648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999c1c-23d1-4276-968e-362b5d9e38c6 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:59.721183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999c1c-23d1-4276-968e-362b5d9e38c6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:59.721183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999c1c-23d1-4276-968e-362b5d9e38c6 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:59.723041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 675/1318] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:59.728420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d692-51f3-418a-9702-bd640e3dd510 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:59.728851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d692-51f3-418a-9702-bd640e3dd510 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:59.728948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d692-51f3-418a-9702-bd640e3dd510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:59.794020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2a16d692-51f3-418a-9702-bd640e3dd510 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:59.795226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2a16d692-51f3-418a-9702-bd640e3dd510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:59.889832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 644/1319] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:00.186548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa999c1c-23d1-4276-968e-362b5d9e38c6 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:00.188108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-aa999c1c-23d1-4276-968e-362b5d9e38c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:00.292262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa999c1c-23d1-4276-968e-362b5d9e38c6 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:00.367267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a50fc5-c582-4d74-aca3-db06c71467fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:00.367855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50fc5-c582-4d74-aca3-db06c71467fa service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:00.368138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50fc5-c582-4d74-aca3-db06c71467fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:00.368411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50fc5-c582-4d74-aca3-db06c71467fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:00.370023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-38a50fc5-c582-4d74-aca3-db06c71467fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:00.377010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:00.478767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a50fc5-c582-4d74-aca3-db06c71467fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:00.480145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a50fc5-c582-4d74-aca3-db06c71467fa service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:00.498540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 676/1320] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:03.319785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413822-7d89-4633-b12d-8afb1acd68c7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.320348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413822-7d89-4633-b12d-8afb1acd68c7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.320348 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413822-7d89-4633-b12d-8afb1acd68c7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.321728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 645/1321] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:03.327075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92899d-37bf-44fa-bbc7-a5e9309b9e15 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.327537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92899d-37bf-44fa-bbc7-a5e9309b9e15 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.327657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92899d-37bf-44fa-bbc7-a5e9309b9e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.398569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4f92899d-37bf-44fa-bbc7-a5e9309b9e15 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:03.399840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4f92899d-37bf-44fa-bbc7-a5e9309b9e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:03.466981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:03.511255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 677/1322] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:03.802594 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd413822-7d89-4633-b12d-8afb1acd68c7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:03.804218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cd413822-7d89-4633-b12d-8afb1acd68c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:03.824486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:03.910199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd413822-7d89-4633-b12d-8afb1acd68c7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:03.991438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1ec84-2c83-456b-b73f-82aec710b649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:03.992079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ec84-2c83-456b-b73f-82aec710b649 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.992356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ec84-2c83-456b-b73f-82aec710b649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.992631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ec84-2c83-456b-b73f-82aec710b649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.994253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-72b1ec84-2c83-456b-b73f-82aec710b649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:04.067315 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:04.104434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1ec84-2c83-456b-b73f-82aec710b649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:04.105856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1ec84-2c83-456b-b73f-82aec710b649 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:04.124571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 646/1323] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:06.363910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caa9f-e8c5-4aa8-bb66-5bfc9ed786eb None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:06.364901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caa9f-e8c5-4aa8-bb66-5bfc9ed786eb None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:06.364901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caa9f-e8c5-4aa8-bb66-5bfc9ed786eb None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:06.365815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 678/1324] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:17:06.371402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14f10-4961-4270-9ee8-7276b9de9075 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:06.371983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14f10-4961-4270-9ee8-7276b9de9075 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:06.371983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14f10-4961-4270-9ee8-7276b9de9075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:06.439103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-dab14f10-4961-4270-9ee8-7276b9de9075 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:06.440359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dab14f10-4961-4270-9ee8-7276b9de9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:06.547798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 647/1325] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:06.825599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0caa9f-e8c5-4aa8-bb66-5bfc9ed786eb None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:06.827140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ef0caa9f-e8c5-4aa8-bb66-5bfc9ed786eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:06.931627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0caa9f-e8c5-4aa8-bb66-5bfc9ed786eb None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:07.006796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4135-149a-4b09-8178-d0430c1abf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:07.007395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4135-149a-4b09-8178-d0430c1abf38 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:07.007666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4135-149a-4b09-8178-d0430c1abf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:07.007969 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4135-149a-4b09-8178-d0430c1abf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:07.009561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ea5b4135-149a-4b09-8178-d0430c1abf38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:07.028784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:07.125476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b4135-149a-4b09-8178-d0430c1abf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:07.126836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b4135-149a-4b09-8178-d0430c1abf38 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:07.145327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 679/1326] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:09.352001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be8844-5b1f-4b27-9daa-3324a0785360 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.352571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be8844-5b1f-4b27-9daa-3324a0785360 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.352571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be8844-5b1f-4b27-9daa-3324a0785360 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.353904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 648/1327] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:09.359297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd721b5b-2ac6-42e3-9c53-3d3bb7ed9e3a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.359720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd721b5b-2ac6-42e3-9c53-3d3bb7ed9e3a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.359882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd721b5b-2ac6-42e3-9c53-3d3bb7ed9e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.429080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-fd721b5b-2ac6-42e3-9c53-3d3bb7ed9e3a None None] MFA Rules not processed for user `fc80b9647e8c4c9fbc6e77f46f564e89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:09.430442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-fd721b5b-2ac6-42e3-9c53-3d3bb7ed9e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:09.498160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:09.531544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 680/1328] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:09.837850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdb876-7074-42fd-bc97-715bc250fb31 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.838137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdb876-7074-42fd-bc97-715bc250fb31 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.838559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdb876-7074-42fd-bc97-715bc250fb31 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.840289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 649/1329] 10.222.0.65 () {54 vars in 965 bytes} [Wed Sep 14 15:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:09.849616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751553e-8083-4be7-a4f3-28f7854b019d None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.849900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751553e-8083-4be7-a4f3-28f7854b019d None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.850172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751553e-8083-4be7-a4f3-28f7854b019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.952123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-6751553e-8083-4be7-a4f3-28f7854b019d None None] MFA Rules not processed for user `317574f1c46a45d9b600329f73a993f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:09.953977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-6751553e-8083-4be7-a4f3-28f7854b019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:10.064150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 681/1330] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Sep 14 15:17:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:10.064813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdb876-7074-42fd-bc97-715bc250fb31 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:10.067668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7ffdb876-7074-42fd-bc97-715bc250fb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:10.104677 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:10.181321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdb876-7074-42fd-bc97-715bc250fb31 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:10.257337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f71dd-8b25-4213-9c34-83579c3f413f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:10.257944 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f71dd-8b25-4213-9c34-83579c3f413f service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:10.258217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f71dd-8b25-4213-9c34-83579c3f413f service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:10.258483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f71dd-8b25-4213-9c34-83579c3f413f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:10.260132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c98f71dd-8b25-4213-9c34-83579c3f413f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:10.353213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:10.386130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f71dd-8b25-4213-9c34-83579c3f413f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:10.387488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f71dd-8b25-4213-9c34-83579c3f413f service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:10.407585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 650/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:17:13.211946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0848-dfb1-4e63-be5b-b97aa23d45e1 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.212587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0848-dfb1-4e63-be5b-b97aa23d45e1 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.212587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0848-dfb1-4e63-be5b-b97aa23d45e1 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.213960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 682/1332] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:13.219528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb9d7-fcb6-4119-a950-8f331755ae98 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.219978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb9d7-fcb6-4119-a950-8f331755ae98 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.220109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb9d7-fcb6-4119-a950-8f331755ae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.285739 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7abfb9d7-fcb6-4119-a950-8f331755ae98 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:13.286933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7abfb9d7-fcb6-4119-a950-8f331755ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:13.382022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 651/1333] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:13.662356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0848-dfb1-4e63-be5b-b97aa23d45e1 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:13.663922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-34ae0848-dfb1-4e63-be5b-b97aa23d45e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:13.733357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:13.766850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0848-dfb1-4e63-be5b-b97aa23d45e1 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:13.839913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4811f3-59ad-4b7c-a615-94ec8eb5e88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:13.840514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4811f3-59ad-4b7c-a615-94ec8eb5e88d service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.840793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4811f3-59ad-4b7c-a615-94ec8eb5e88d service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.841062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4811f3-59ad-4b7c-a615-94ec8eb5e88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.842666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4c4811f3-59ad-4b7c-a615-94ec8eb5e88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:13.953510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4811f3-59ad-4b7c-a615-94ec8eb5e88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:13.954971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4811f3-59ad-4b7c-a615-94ec8eb5e88d service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:13.965456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:13.974733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 683/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:16.200275 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0e0f3-1d9d-423a-b430-1b9a3ac3a7a9 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:16.200807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0e0f3-1d9d-423a-b430-1b9a3ac3a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:16.200807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0e0f3-1d9d-423a-b430-1b9a3ac3a7a9 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:16.202185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 652/1335] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:16.207947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab48362-a94d-444a-8df6-0b139be114d6 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:16.208353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab48362-a94d-444a-8df6-0b139be114d6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:16.208489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab48362-a94d-444a-8df6-0b139be114d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:16.274843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-bab48362-a94d-444a-8df6-0b139be114d6 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:16.276067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-bab48362-a94d-444a-8df6-0b139be114d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:16.373058 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 684/1336] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:16.657347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0e0f3-1d9d-423a-b430-1b9a3ac3a7a9 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:16.658913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1be0e0f3-1d9d-423a-b430-1b9a3ac3a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:16.698613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:16.760653 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0e0f3-1d9d-423a-b430-1b9a3ac3a7a9 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:16.831652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c99dd-abf6-4ec1-87f5-aac9fad9c550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:16.832272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c99dd-abf6-4ec1-87f5-aac9fad9c550 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:16.832545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c99dd-abf6-4ec1-87f5-aac9fad9c550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:16.832810 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c99dd-abf6-4ec1-87f5-aac9fad9c550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:16.834388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a31c99dd-abf6-4ec1-87f5-aac9fad9c550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:16.916789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:16.943590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c99dd-abf6-4ec1-87f5-aac9fad9c550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:16.945070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c99dd-abf6-4ec1-87f5-aac9fad9c550 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:16.963204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 653/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:19.593627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15baef-7eda-4a3a-b8aa-08d7f4b96f3e None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:19.594253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15baef-7eda-4a3a-b8aa-08d7f4b96f3e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:19.594253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15baef-7eda-4a3a-b8aa-08d7f4b96f3e None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:19.595547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 685/1338] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:19.601023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a34e8-032e-4f72-8737-117b04d0b539 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:19.601466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a34e8-032e-4f72-8737-117b04d0b539 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:19.601598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a34e8-032e-4f72-8737-117b04d0b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:19.668092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9d7a34e8-032e-4f72-8737-117b04d0b539 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:19.669351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9d7a34e8-032e-4f72-8737-117b04d0b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:19.766262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 654/1339] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:20.047985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15baef-7eda-4a3a-b8aa-08d7f4b96f3e None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:20.049519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ac15baef-7eda-4a3a-b8aa-08d7f4b96f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:20.126030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:20.154782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15baef-7eda-4a3a-b8aa-08d7f4b96f3e None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:20.230633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89370f-f170-4052-a06e-ded54d1ab5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:20.231351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89370f-f170-4052-a06e-ded54d1ab5ea service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:20.231713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89370f-f170-4052-a06e-ded54d1ab5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:20.232047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89370f-f170-4052-a06e-ded54d1ab5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:20.233950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7b89370f-f170-4052-a06e-ded54d1ab5ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:20.345334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89370f-f170-4052-a06e-ded54d1ab5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:20.346660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89370f-f170-4052-a06e-ded54d1ab5ea service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:20.367802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 686/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:24.515185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2b142-3314-40b6-ae71-8e3f4125a689 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:24.518094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2b142-3314-40b6-ae71-8e3f4125a689 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:24.518564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2b142-3314-40b6-ae71-8e3f4125a689 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:24.520486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 655/1341] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:24.525849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb91cf-d050-4c7a-ba07-b75c831a7129 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:24.526297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb91cf-d050-4c7a-ba07-b75c831a7129 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:24.526494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb91cf-d050-4c7a-ba07-b75c831a7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:24.532616 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:24.603180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-bdcb91cf-d050-4c7a-ba07-b75c831a7129 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:24.604417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-bdcb91cf-d050-4c7a-ba07-b75c831a7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:24.716155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 687/1342] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:25.010646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2b142-3314-40b6-ae71-8e3f4125a689 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:25.012317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-15a2b142-3314-40b6-ae71-8e3f4125a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:25.062681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:25.118926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2b142-3314-40b6-ae71-8e3f4125a689 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:25.194135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6ca03-9956-4868-b6a7-f27c1c5d0ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:25.194735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ca03-9956-4868-b6a7-f27c1c5d0ded service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:25.195009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ca03-9956-4868-b6a7-f27c1c5d0ded service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:25.195273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ca03-9956-4868-b6a7-f27c1c5d0ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:25.196895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-94d6ca03-9956-4868-b6a7-f27c1c5d0ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:25.299562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:25.317046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6ca03-9956-4868-b6a7-f27c1c5d0ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:25.318479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6ca03-9956-4868-b6a7-f27c1c5d0ded service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:25.339447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 656/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:28.126923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5db0-517f-4c97-8598-959b82cf7467 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:28.127435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5db0-517f-4c97-8598-959b82cf7467 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:28.127435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5db0-517f-4c97-8598-959b82cf7467 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:28.128800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 688/1344] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:28.134234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ee612-d8cd-4f66-b387-b6b8f3757bd4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:28.134682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ee612-d8cd-4f66-b387-b6b8f3757bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:28.134777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ee612-d8cd-4f66-b387-b6b8f3757bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:28.203796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-974ee612-d8cd-4f66-b387-b6b8f3757bd4 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:28.205042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-974ee612-d8cd-4f66-b387-b6b8f3757bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:28.308180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 657/1345] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:28.592120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5db0-517f-4c97-8598-959b82cf7467 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:28.593754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-aa0f5db0-517f-4c97-8598-959b82cf7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:28.691585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:28.709101 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5db0-517f-4c97-8598-959b82cf7467 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:28.790416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffccee5-2b06-44ec-96d1-69349d409899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:28.791042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffccee5-2b06-44ec-96d1-69349d409899 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:28.791289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffccee5-2b06-44ec-96d1-69349d409899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:28.791555 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffccee5-2b06-44ec-96d1-69349d409899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:28.793202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8ffccee5-2b06-44ec-96d1-69349d409899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:28.908630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffccee5-2b06-44ec-96d1-69349d409899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:28.910075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffccee5-2b06-44ec-96d1-69349d409899 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:28.928790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 689/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:33.180748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480c48-a4fa-45f8-969e-2972e2cbc48f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:33.181215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480c48-a4fa-45f8-969e-2972e2cbc48f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:33.181336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480c48-a4fa-45f8-969e-2972e2cbc48f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:33.182840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 658/1347] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:33.188080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81cfcf-f633-4fbe-9ec4-ded3230c91c1 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:33.188503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81cfcf-f633-4fbe-9ec4-ded3230c91c1 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:33.188614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81cfcf-f633-4fbe-9ec4-ded3230c91c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:33.204931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:33.260136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-de81cfcf-f633-4fbe-9ec4-ded3230c91c1 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:33.261345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-de81cfcf-f633-4fbe-9ec4-ded3230c91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:33.358001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 690/1348] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:33.643860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480c48-a4fa-45f8-969e-2972e2cbc48f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:33.645420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4a480c48-a4fa-45f8-969e-2972e2cbc48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:33.703274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:33.749882 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480c48-a4fa-45f8-969e-2972e2cbc48f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:33.827258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1798bf4-747f-42a6-92bd-aa368fd58d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:33.827905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1798bf4-747f-42a6-92bd-aa368fd58d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:33.828185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1798bf4-747f-42a6-92bd-aa368fd58d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:33.828455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1798bf4-747f-42a6-92bd-aa368fd58d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:33.830106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c1798bf4-747f-42a6-92bd-aa368fd58d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:33.939209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:33.943544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1798bf4-747f-42a6-92bd-aa368fd58d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:33.945022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1798bf4-747f-42a6-92bd-aa368fd58d5c service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:33.963964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 659/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:38.990692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb53a6-27f5-4c38-b71c-e2cc4bf49038 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:38.991216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb53a6-27f5-4c38-b71c-e2cc4bf49038 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:38.991216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb53a6-27f5-4c38-b71c-e2cc4bf49038 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:38.992866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 691/1350] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:39.004176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa3-a828-4185-99e4-093a39808567 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:39.004176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa3-a828-4185-99e4-093a39808567 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:39.004770 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa3-a828-4185-99e4-093a39808567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:39.106740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8ef71fa3-a828-4185-99e4-093a39808567 None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:39.108388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8ef71fa3-a828-4185-99e4-093a39808567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:39.273217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 660/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:17:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:43.356544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=59 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:43.540945 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308094a-6f33-465c-b849-4145f18370e1 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:43.541213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308094a-6f33-465c-b849-4145f18370e1 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:43.541661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308094a-6f33-465c-b849-4145f18370e1 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:43.543031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 692/1352] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:43.548756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062c4d-f51c-4f59-a8f0-dd800468d147 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:43.549249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062c4d-f51c-4f59-a8f0-dd800468d147 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:43.549519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062c4d-f51c-4f59-a8f0-dd800468d147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:43.619258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:43.640281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7f062c4d-f51c-4f59-a8f0-dd800468d147 None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:43.641530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7f062c4d-f51c-4f59-a8f0-dd800468d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:43.755887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 661/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:17:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:45.081424 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143575c-fab8-4e58-8ea8-f697e7128747 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:45.082480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143575c-fab8-4e58-8ea8-f697e7128747 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:45.082649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143575c-fab8-4e58-8ea8-f697e7128747 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:45.084197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 693/1354] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:45.089569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923455b0-9d9e-4458-b1a8-474c6da0bb67 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:45.090002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923455b0-9d9e-4458-b1a8-474c6da0bb67 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:45.090130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923455b0-9d9e-4458-b1a8-474c6da0bb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:45.170173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-923455b0-9d9e-4458-b1a8-474c6da0bb67 None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:45.171398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-923455b0-9d9e-4458-b1a8-474c6da0bb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:45.213561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:45.281466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 662/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:17:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:48.905360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd0456-f20b-4c43-90ed-51d2ed90a2aa None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:48.905919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd0456-f20b-4c43-90ed-51d2ed90a2aa None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:48.906028 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd0456-f20b-4c43-90ed-51d2ed90a2aa None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:48.907499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 694/1356] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:48.914266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848935-6e84-4d79-8f1c-c36538274429 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:48.914795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848935-6e84-4d79-8f1c-c36538274429 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:48.914795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848935-6e84-4d79-8f1c-c36538274429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:48.990019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-29848935-6e84-4d79-8f1c-c36538274429 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:48.991232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-29848935-6e84-4d79-8f1c-c36538274429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:49.099958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 663/1357] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:49.404892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ea61-e9bc-4060-a6f2-55fed7334abc None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:49.405293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ea61-e9bc-4060-a6f2-55fed7334abc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:49.405667 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ea61-e9bc-4060-a6f2-55fed7334abc None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:49.407321 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 695/1358] 10.222.0.65 () {54 vars in 962 bytes} [Wed Sep 14 15:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:17:49.424737 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87840-cdc6-4663-ae11-4f9ba5af1939 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:49.425026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87840-cdc6-4663-ae11-4f9ba5af1939 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:49.425916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87840-cdc6-4663-ae11-4f9ba5af1939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:49.449380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:49.518558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-90a87840-cdc6-4663-ae11-4f9ba5af1939 None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:49.520581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-90a87840-cdc6-4663-ae11-4f9ba5af1939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:49.680660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 664/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Sep 14 15:17:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:49.690668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ea61-e9bc-4060-a6f2-55fed7334abc None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:49.692340 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7962ea61-e9bc-4060-a6f2-55fed7334abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:49.849563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ea61-e9bc-4060-a6f2-55fed7334abc None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:49.928618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:49.979326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316489d-96f3-43bc-b4d2-9ddf5be6db5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:49.980224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316489d-96f3-43bc-b4d2-9ddf5be6db5e service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:49.980612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316489d-96f3-43bc-b4d2-9ddf5be6db5e service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:49.981018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316489d-96f3-43bc-b4d2-9ddf5be6db5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:49.984654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-2316489d-96f3-43bc-b4d2-9ddf5be6db5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:50.094037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316489d-96f3-43bc-b4d2-9ddf5be6db5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:50.095842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316489d-96f3-43bc-b4d2-9ddf5be6db5e service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:50.117368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 696/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:52.517476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aefd0-6145-4b9a-879a-13b7516df067 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:52.518042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aefd0-6145-4b9a-879a-13b7516df067 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:52.518042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aefd0-6145-4b9a-879a-13b7516df067 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:52.523696 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 665/1361] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:52.525366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9509c-4196-4661-8e1e-bb6ba9b5ed9c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:52.525863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9509c-4196-4661-8e1e-bb6ba9b5ed9c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:52.526030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9509c-4196-4661-8e1e-bb6ba9b5ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:52.597628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-bef9509c-4196-4661-8e1e-bb6ba9b5ed9c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:52.600763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-bef9509c-4196-4661-8e1e-bb6ba9b5ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:52.647430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:52.711565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 697/1362] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:53.005328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aefd0-6145-4b9a-879a-13b7516df067 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:53.006872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-824aefd0-6145-4b9a-879a-13b7516df067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:53.083647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:53.186106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aefd0-6145-4b9a-879a-13b7516df067 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:53.311368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328ee5a-26d1-4fdf-b841-4a72dcede6ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:53.312006 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328ee5a-26d1-4fdf-b841-4a72dcede6ff service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:53.312284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328ee5a-26d1-4fdf-b841-4a72dcede6ff service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:53.312551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328ee5a-26d1-4fdf-b841-4a72dcede6ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:53.314173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c328ee5a-26d1-4fdf-b841-4a72dcede6ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:53.337835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:53.410307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328ee5a-26d1-4fdf-b841-4a72dcede6ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:53.411962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328ee5a-26d1-4fdf-b841-4a72dcede6ff service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:53.430950 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 666/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:55.935132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768ffa-1242-4786-ad44-98fd14a6d3db None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:55.935729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768ffa-1242-4786-ad44-98fd14a6d3db None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:55.935729 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768ffa-1242-4786-ad44-98fd14a6d3db None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:55.937269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 698/1364] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:55.944564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bc61b-f8b1-416c-b911-06df0a19b87c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:55.945037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bc61b-f8b1-416c-b911-06df0a19b87c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:55.945149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bc61b-f8b1-416c-b911-06df0a19b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:56.029255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d41bc61b-f8b1-416c-b911-06df0a19b87c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:56.030483 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d41bc61b-f8b1-416c-b911-06df0a19b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:56.137847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:56.143884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 667/1365] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:56.448684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01108943-5860-4dd1-9726-6b239881ed20 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:56.448968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01108943-5860-4dd1-9726-6b239881ed20 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:56.449244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01108943-5860-4dd1-9726-6b239881ed20 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:56.450745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 699/1366] 10.222.0.65 () {54 vars in 962 bytes} [Wed Sep 14 15:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:56.456105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b947ea-c322-4c87-b03d-036f5c8954fc None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:56.456451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b947ea-c322-4c87-b03d-036f5c8954fc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:56.456749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b947ea-c322-4c87-b03d-036f5c8954fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:56.542530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f6b947ea-c322-4c87-b03d-036f5c8954fc None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:56.543728 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f6b947ea-c322-4c87-b03d-036f5c8954fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:56.696155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 668/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Sep 14 15:17:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:56.704733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01108943-5860-4dd1-9726-6b239881ed20 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:56.706371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-01108943-5860-4dd1-9726-6b239881ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:56.876807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01108943-5860-4dd1-9726-6b239881ed20 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:56.901132 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:57.037811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9fb40-9f0d-4ec6-9d45-ba2c88ae3ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:57.038488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9fb40-9f0d-4ec6-9d45-ba2c88ae3ef3 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:57.038654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9fb40-9f0d-4ec6-9d45-ba2c88ae3ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:57.038933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9fb40-9f0d-4ec6-9d45-ba2c88ae3ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:57.040785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-6ff9fb40-9f0d-4ec6-9d45-ba2c88ae3ef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:57.160481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1d59-641f-492b-97b4-45f931ec785f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:57.161049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1d59-641f-492b-97b4-45f931ec785f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:57.161049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1d59-641f-492b-97b4-45f931ec785f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:57.162633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9fb40-9f0d-4ec6-9d45-ba2c88ae3ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:57.163047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 669/1368] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:57.164322 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9fb40-9f0d-4ec6-9d45-ba2c88ae3ef3 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:57.168523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a29d5-2b4d-49da-8877-23dc619e2295 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:57.168820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a29d5-2b4d-49da-8877-23dc619e2295 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:57.169095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a29d5-2b4d-49da-8877-23dc619e2295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:57.184710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 700/1369] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:57.235160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:57.246992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-486a29d5-2b4d-49da-8877-23dc619e2295 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:57.248254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-486a29d5-2b4d-49da-8877-23dc619e2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:57.388502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 670/1370] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:17:57.717261 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b050-ff89-4f79-9ead-dcb0c859b8d2 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:57.717597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b050-ff89-4f79-9ead-dcb0c859b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:57.717872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b050-ff89-4f79-9ead-dcb0c859b8d2 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:57.720350 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 701/1371] 10.222.0.65 () {54 vars in 964 bytes} [Wed Sep 14 15:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:57.724365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23942e41-40ed-488b-8add-af99e4edec70 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:57.724650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23942e41-40ed-488b-8add-af99e4edec70 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:57.724919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23942e41-40ed-488b-8add-af99e4edec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:57.804043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-23942e41-40ed-488b-8add-af99e4edec70 None None] MFA Rules not processed for user `8d4b2587bd2c4c5f9e3b8d678432d54b`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:57.805259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-23942e41-40ed-488b-8add-af99e4edec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:57.881158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:57.889712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 671/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Sep 14 15:17:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:57.899569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33b050-ff89-4f79-9ead-dcb0c859b8d2 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:57.901316 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-dd33b050-ff89-4f79-9ead-dcb0c859b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:57.934491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:58.017708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33b050-ff89-4f79-9ead-dcb0c859b8d2 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:58.100255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73009db9-e253-441a-a776-ed7f595f2348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d4b2587bd2c4c5f9e3b8d678432d54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:58.100915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73009db9-e253-441a-a776-ed7f595f2348 service cinder] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:58.101222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73009db9-e253-441a-a776-ed7f595f2348 service cinder] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:58.101591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73009db9-e253-441a-a776-ed7f595f2348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:58.103263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-73009db9-e253-441a-a776-ed7f595f2348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:58.190803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:58.227547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73009db9-e253-441a-a776-ed7f595f2348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:58.229145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73009db9-e253-441a-a776-ed7f595f2348 service cinder] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:58.248349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 702/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:17:59.458598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae5917-e86b-409b-949f-3cb8e29fd517 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:59.459142 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae5917-e86b-409b-949f-3cb8e29fd517 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:59.459227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae5917-e86b-409b-949f-3cb8e29fd517 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:59.460620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 672/1374] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:59.466013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02696-3d68-4e25-9134-9590a5504fd6 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:59.466445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02696-3d68-4e25-9134-9590a5504fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:59.466544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02696-3d68-4e25-9134-9590a5504fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:59.535353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-2cf02696-3d68-4e25-9134-9590a5504fd6 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:59.536607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-2cf02696-3d68-4e25-9134-9590a5504fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:59.638546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 703/1375] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:17:59.930080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae5917-e86b-409b-949f-3cb8e29fd517 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:59.931670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-34ae5917-e86b-409b-949f-3cb8e29fd517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:00.094837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae5917-e86b-409b-949f-3cb8e29fd517 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:00.172448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:00.228300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ee7e7-f5c7-4e59-9201-890029976c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:00.228914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee7e7-f5c7-4e59-9201-890029976c28 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:00.229193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee7e7-f5c7-4e59-9201-890029976c28 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:00.229469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee7e7-f5c7-4e59-9201-890029976c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:00.231117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-734ee7e7-f5c7-4e59-9201-890029976c28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:00.329545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ee7e7-f5c7-4e59-9201-890029976c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:00.331745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ee7e7-f5c7-4e59-9201-890029976c28 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:00.350762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 673/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:02.601636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d767f-687d-40b3-b4aa-6d2ac76d35a5 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:02.602125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d767f-687d-40b3-b4aa-6d2ac76d35a5 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:02.602369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d767f-687d-40b3-b4aa-6d2ac76d35a5 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:02.603885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 704/1377] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:02.609180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e638b0-bec1-41d4-b7c6-cad17d0e5989 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:02.609601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e638b0-bec1-41d4-b7c6-cad17d0e5989 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:02.609795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e638b0-bec1-41d4-b7c6-cad17d0e5989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:02.684981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c7e638b0-bec1-41d4-b7c6-cad17d0e5989 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:02.686268 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c7e638b0-bec1-41d4-b7c6-cad17d0e5989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:02.716276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:02.792325 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 674/1378] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:03.078559 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d767f-687d-40b3-b4aa-6d2ac76d35a5 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:03.080117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-cb1d767f-687d-40b3-b4aa-6d2ac76d35a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:03.119157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:03.237044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d767f-687d-40b3-b4aa-6d2ac76d35a5 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:03.354163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:03.361460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014f5b6-e54c-4687-a32f-22bee4cf8a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:03.362073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014f5b6-e54c-4687-a32f-22bee4cf8a20 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:03.362371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014f5b6-e54c-4687-a32f-22bee4cf8a20 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:03.362633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014f5b6-e54c-4687-a32f-22bee4cf8a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:03.364249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9014f5b6-e54c-4687-a32f-22bee4cf8a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:03.461900 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014f5b6-e54c-4687-a32f-22bee4cf8a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:03.463492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014f5b6-e54c-4687-a32f-22bee4cf8a20 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:03.482488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 705/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:05.736332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1aa5-2f7c-4788-93f7-6d4e8c1a4b7d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:05.737055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1aa5-2f7c-4788-93f7-6d4e8c1a4b7d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:05.737055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1aa5-2f7c-4788-93f7-6d4e8c1a4b7d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:05.742583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 675/1380] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:05.743906 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb422c2-192a-475c-bf05-f38c14d4f1cf None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:05.744418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb422c2-192a-475c-bf05-f38c14d4f1cf None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:05.744418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb422c2-192a-475c-bf05-f38c14d4f1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:05.823936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9eb422c2-192a-475c-bf05-f38c14d4f1cf None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:05.825026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9eb422c2-192a-475c-bf05-f38c14d4f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:05.900234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:05.942447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 706/1381] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:18:06.310998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1aa5-2f7c-4788-93f7-6d4e8c1a4b7d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:06.312568 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a04b1aa5-2f7c-4788-93f7-6d4e8c1a4b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:06.475698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1aa5-2f7c-4788-93f7-6d4e8c1a4b7d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:06.489974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:06.599762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272acf0-e34a-4923-8c22-d59811194a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:06.600374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272acf0-e34a-4923-8c22-d59811194a08 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:06.600849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272acf0-e34a-4923-8c22-d59811194a08 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:06.600988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272acf0-e34a-4923-8c22-d59811194a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:06.602684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9272acf0-e34a-4923-8c22-d59811194a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:06.701105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272acf0-e34a-4923-8c22-d59811194a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:06.702840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272acf0-e34a-4923-8c22-d59811194a08 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:06.723232 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 676/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:09.600224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40064-c21e-42b7-81ab-5ec0bb80abef None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:09.600746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40064-c21e-42b7-81ab-5ec0bb80abef None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:09.601356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40064-c21e-42b7-81ab-5ec0bb80abef None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:09.602807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 707/1383] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:09.609471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e502c-e5d8-4da0-8642-3c47b965b432 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:09.609926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e502c-e5d8-4da0-8642-3c47b965b432 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:09.610031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e502c-e5d8-4da0-8642-3c47b965b432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:09.633862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:09.680830 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-951e502c-e5d8-4da0-8642-3c47b965b432 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:09.682007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-951e502c-e5d8-4da0-8642-3c47b965b432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:09.795754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 677/1384] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:10.078048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40064-c21e-42b7-81ab-5ec0bb80abef None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:10.080274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-66c40064-c21e-42b7-81ab-5ec0bb80abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:10.275135 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40064-c21e-42b7-81ab-5ec0bb80abef None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:10.338814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:10.431351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9365b-6d9a-489c-ad03-670d6e7f4ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:10.432538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9365b-6d9a-489c-ad03-670d6e7f4ff7 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:10.432934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9365b-6d9a-489c-ad03-670d6e7f4ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:10.433303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9365b-6d9a-489c-ad03-670d6e7f4ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:10.435654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b7f9365b-6d9a-489c-ad03-670d6e7f4ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:10.538494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9365b-6d9a-489c-ad03-670d6e7f4ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:10.540294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9365b-6d9a-489c-ad03-670d6e7f4ff7 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:10.560097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 708/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:12.746238 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da866-1354-4f35-813f-8b98b380c603 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:12.746848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da866-1354-4f35-813f-8b98b380c603 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:12.746848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da866-1354-4f35-813f-8b98b380c603 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:12.748189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 678/1386] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:12.753975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca81a9-9331-4795-962a-d94938f09655 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:12.754401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca81a9-9331-4795-962a-d94938f09655 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:12.754508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca81a9-9331-4795-962a-d94938f09655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:12.825066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9fca81a9-9331-4795-962a-d94938f09655 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:12.826263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9fca81a9-9331-4795-962a-d94938f09655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:12.834840 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:12.923574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 709/1387] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:13.210914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81da866-1354-4f35-813f-8b98b380c603 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:13.212591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a81da866-1354-4f35-813f-8b98b380c603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:13.309701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:13.367192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81da866-1354-4f35-813f-8b98b380c603 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:13.490571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb775deb-aeb7-4d7e-af0d-a6c1bdbeff4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:13.491103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb775deb-aeb7-4d7e-af0d-a6c1bdbeff4b service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:13.491380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb775deb-aeb7-4d7e-af0d-a6c1bdbeff4b service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:13.491652 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb775deb-aeb7-4d7e-af0d-a6c1bdbeff4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:13.493410 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-bb775deb-aeb7-4d7e-af0d-a6c1bdbeff4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:13.556553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:13.587240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca333d-f363-4c0e-861a-737f664505f8 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:13.587517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca333d-f363-4c0e-861a-737f664505f8 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:13.587789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca333d-f363-4c0e-861a-737f664505f8 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:13.588141 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb775deb-aeb7-4d7e-af0d-a6c1bdbeff4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:13.589206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 710/1388] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:13.589850 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb775deb-aeb7-4d7e-af0d-a6c1bdbeff4b service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:13.594190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288a4b-7e26-46c8-8e50-03ee2082d63c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:13.594474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288a4b-7e26-46c8-8e50-03ee2082d63c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:13.594752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288a4b-7e26-46c8-8e50-03ee2082d63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:13.613916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 679/1389] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:18:13.673973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-d3288a4b-7e26-46c8-8e50-03ee2082d63c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:13.675376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-d3288a4b-7e26-46c8-8e50-03ee2082d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:13.781401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:13.794912 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 711/1390] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:18:14.103147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74169-e1bf-4439-aa69-01a0ee5546f4 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:14.103687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74169-e1bf-4439-aa69-01a0ee5546f4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:14.103783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74169-e1bf-4439-aa69-01a0ee5546f4 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:14.105611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 680/1391] 10.222.0.65 () {54 vars in 966 bytes} [Wed Sep 14 15:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:14.111459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec436c-726f-47de-a55d-e889db622af0 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:14.112127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec436c-726f-47de-a55d-e889db622af0 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:14.112466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec436c-726f-47de-a55d-e889db622af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:14.194597 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-a1ec436c-726f-47de-a55d-e889db622af0 None None] MFA Rules not processed for user `344958332b5549558b26d199e53b8b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:14.195796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-a1ec436c-726f-47de-a55d-e889db622af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:14.271051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 712/1392] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Sep 14 15:18:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:18:14.280448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74169-e1bf-4439-aa69-01a0ee5546f4 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:14.282046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b4f74169-e1bf-4439-aa69-01a0ee5546f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:14.388472 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74169-e1bf-4439-aa69-01a0ee5546f4 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:14.463611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48efc0b-a429-41a5-8fec-1879016a03e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344958332b5549558b26d199e53b8b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:14.464234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48efc0b-a429-41a5-8fec-1879016a03e8 service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:14.464512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48efc0b-a429-41a5-8fec-1879016a03e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:14.464783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48efc0b-a429-41a5-8fec-1879016a03e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:14.466382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c48efc0b-a429-41a5-8fec-1879016a03e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:14.476121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:14.583228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48efc0b-a429-41a5-8fec-1879016a03e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:14.584752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48efc0b-a429-41a5-8fec-1879016a03e8 service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:14.606990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 681/1393] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:15.353528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475d60e-4033-47c3-be66-b37a294a3c1a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:15.354064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475d60e-4033-47c3-be66-b37a294a3c1a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:15.354064 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475d60e-4033-47c3-be66-b37a294a3c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:15.423970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4475d60e-4033-47c3-be66-b37a294a3c1a None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:15.425530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4475d60e-4033-47c3-be66-b37a294a3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:15.462612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:15.524262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 713/1394] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:15.567702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105bf6-e258-4a6d-8cab-71d3f49a0bff None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:15.568239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105bf6-e258-4a6d-8cab-71d3f49a0bff None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:15.568446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105bf6-e258-4a6d-8cab-71d3f49a0bff None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:15.569879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 682/1395] 10.222.0.65 () {54 vars in 943 bytes} [Wed Sep 14 15:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:15.576665 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94c496-4b1e-4eab-979a-df3cdc211349 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:15.576978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94c496-4b1e-4eab-979a-df3cdc211349 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:15.577249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94c496-4b1e-4eab-979a-df3cdc211349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:15.659514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-8c94c496-4b1e-4eab-979a-df3cdc211349 None None] MFA Rules not processed for user `59d8c0a83f53476abaac005263ac3bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:15.660732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8c94c496-4b1e-4eab-979a-df3cdc211349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:15.770217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 714/1396] 10.222.0.65 () {58 vars in 1040 bytes} [Wed Sep 14 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:15.780486 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105bf6-e258-4a6d-8cab-71d3f49a0bff None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:15.782051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-62105bf6-e258-4a6d-8cab-71d3f49a0bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:15.890023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7010-3b10-447e-997e-234ff21be19e None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:15.890413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7010-3b10-447e-997e-234ff21be19e None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:15.890701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7010-3b10-447e-997e-234ff21be19e None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:15.892125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 715/1397] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:18:15.897527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:15.897813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:15.898094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:15.898237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:15.908331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:15.928959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105bf6-e258-4a6d-8cab-71d3f49a0bff None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:15.967679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:15.968929 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:16.040570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863c7a0-59b4-4a43-b0d3-5b7f384f2ad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:16.041193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c7a0-59b4-4a43-b0d3-5b7f384f2ad3 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:16.041469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c7a0-59b4-4a43-b0d3-5b7f384f2ad3 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:16.041741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c7a0-59b4-4a43-b0d3-5b7f384f2ad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:16.043907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b863c7a0-59b4-4a43-b0d3-5b7f384f2ad3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:16.077080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 716/1398] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:18:16.132308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863c7a0-59b4-4a43-b0d3-5b7f384f2ad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:16.133939 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863c7a0-59b4-4a43-b0d3-5b7f384f2ad3 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:16.141958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 683/1399] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:18:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:18:16.366605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:16.367843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:16.469694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:16.504968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc36bc4-73c6-4f47-83d3-5490a1f5a7d6 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:16.660047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e6d48-6e82-49f2-a481-f5b9b91f868b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:16.660660 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6d48-6e82-49f2-a481-f5b9b91f868b service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:16.660941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6d48-6e82-49f2-a481-f5b9b91f868b service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:16.661215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6d48-6e82-49f2-a481-f5b9b91f868b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:16.662862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-3f4e6d48-6e82-49f2-a481-f5b9b91f868b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:16.759854 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:16.773000 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e6d48-6e82-49f2-a481-f5b9b91f868b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:16.774722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e6d48-6e82-49f2-a481-f5b9b91f868b service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:16.801777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 717/1400] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:19.034345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a33c-45a2-45ef-afdc-2aac5448b31c None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:19.034954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a33c-45a2-45ef-afdc-2aac5448b31c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:19.034954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a33c-45a2-45ef-afdc-2aac5448b31c None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:19.036302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 684/1401] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:19.041680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcff2c-4a4a-480f-960e-ad3fa8551d0b None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:19.042144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcff2c-4a4a-480f-960e-ad3fa8551d0b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:19.042247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcff2c-4a4a-480f-960e-ad3fa8551d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:19.115533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-6fbcff2c-4a4a-480f-960e-ad3fa8551d0b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:19.116935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-6fbcff2c-4a4a-480f-960e-ad3fa8551d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:19.225513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 718/1402] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:19.516637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046a33c-45a2-45ef-afdc-2aac5448b31c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:19.518808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d046a33c-45a2-45ef-afdc-2aac5448b31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:19.535545 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:19.702761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046a33c-45a2-45ef-afdc-2aac5448b31c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:19.797289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:19.829074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2086aa6-6746-409d-8bde-8fd18cb022d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:19.829592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086aa6-6746-409d-8bde-8fd18cb022d3 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:19.829865 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086aa6-6746-409d-8bde-8fd18cb022d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:19.830130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086aa6-6746-409d-8bde-8fd18cb022d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:19.832266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b2086aa6-6746-409d-8bde-8fd18cb022d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:19.930147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2086aa6-6746-409d-8bde-8fd18cb022d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:19.931744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2086aa6-6746-409d-8bde-8fd18cb022d3 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:19.952146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 685/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:22.195409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041701d-1186-4aa9-9e0f-2a7a7659c7c3 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:22.195998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041701d-1186-4aa9-9e0f-2a7a7659c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:22.195998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041701d-1186-4aa9-9e0f-2a7a7659c7c3 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:22.197352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 719/1404] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:22.202938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907bdd5-c434-4cfc-ad80-23f3e1dd2b6f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:22.203376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907bdd5-c434-4cfc-ad80-23f3e1dd2b6f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:22.219784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907bdd5-c434-4cfc-ad80-23f3e1dd2b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:22.363825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d907bdd5-c434-4cfc-ad80-23f3e1dd2b6f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:22.365173 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d907bdd5-c434-4cfc-ad80-23f3e1dd2b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:22.421044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:22.483957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 686/1405] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:22.787033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041701d-1186-4aa9-9e0f-2a7a7659c7c3 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:22.788847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-f041701d-1186-4aa9-9e0f-2a7a7659c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:22.866075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:22.963107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041701d-1186-4aa9-9e0f-2a7a7659c7c3 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:23.091917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8b211-f83e-4f3d-a07d-dbfa85cac8c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:23.092796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b211-f83e-4f3d-a07d-dbfa85cac8c3 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:23.093074 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b211-f83e-4f3d-a07d-dbfa85cac8c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:23.093466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b211-f83e-4f3d-a07d-dbfa85cac8c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:23.095092 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-c5a8b211-f83e-4f3d-a07d-dbfa85cac8c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:23.119390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:23.195380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8b211-f83e-4f3d-a07d-dbfa85cac8c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:23.197481 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8b211-f83e-4f3d-a07d-dbfa85cac8c3 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:23.218223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 720/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:25.420436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46193e-971e-4f01-a5d3-1ed9343506c4 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:25.420971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46193e-971e-4f01-a5d3-1ed9343506c4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:25.420971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46193e-971e-4f01-a5d3-1ed9343506c4 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:25.422500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 687/1407] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:25.428168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7291c0-f2cb-45ee-acc8-4efa9845bc9a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:25.428168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7291c0-f2cb-45ee-acc8-4efa9845bc9a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:25.428168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7291c0-f2cb-45ee-acc8-4efa9845bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:25.501820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-de7291c0-f2cb-45ee-acc8-4efa9845bc9a None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:25.503898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-de7291c0-f2cb-45ee-acc8-4efa9845bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:25.622263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:25.625433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 721/1408] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:25.913788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46193e-971e-4f01-a5d3-1ed9343506c4 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:25.915328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9f46193e-971e-4f01-a5d3-1ed9343506c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:26.082393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46193e-971e-4f01-a5d3-1ed9343506c4 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:26.124294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:26.211241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d619c9-8c30-4c0b-aa9f-9f14e551aa38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:26.211875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d619c9-8c30-4c0b-aa9f-9f14e551aa38 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:26.212160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d619c9-8c30-4c0b-aa9f-9f14e551aa38 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:26.212435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d619c9-8c30-4c0b-aa9f-9f14e551aa38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:26.214056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-32d619c9-8c30-4c0b-aa9f-9f14e551aa38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:26.323636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d619c9-8c30-4c0b-aa9f-9f14e551aa38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:26.325327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d619c9-8c30-4c0b-aa9f-9f14e551aa38 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:26.349367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 688/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:35.626747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:36.345370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=84 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:39.304169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9b12-13b1-4fec-8b34-9bceca149348 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:39.304763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9b12-13b1-4fec-8b34-9bceca149348 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:39.304763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9b12-13b1-4fec-8b34-9bceca149348 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:39.306140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 722/1410] 10.222.0.65 () {54 vars in 918 bytes} [Wed Sep 14 15:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:39.311301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a56da-77b9-4bd4-916b-0b2f34aea60d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:39.311741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a56da-77b9-4bd4-916b-0b2f34aea60d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:39.311897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a56da-77b9-4bd4-916b-0b2f34aea60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:39.389363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a62a56da-77b9-4bd4-916b-0b2f34aea60d None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:39.390592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a62a56da-77b9-4bd4-916b-0b2f34aea60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:39.498027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 689/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Sep 14 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:39.512972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12fabc-20c9-423a-84b2-bc8ea8706d13 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:39.513251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12fabc-20c9-423a-84b2-bc8ea8706d13 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:39.513520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12fabc-20c9-423a-84b2-bc8ea8706d13 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:39.514857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 723/1412] 10.222.0.65 () {54 vars in 918 bytes} [Wed Sep 14 15:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:39.520272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54875-41af-4be8-b3b1-2d5902800552 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:39.520557 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54875-41af-4be8-b3b1-2d5902800552 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:39.520863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54875-41af-4be8-b3b1-2d5902800552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:39.594998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:39.598114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8ba54875-41af-4be8-b3b1-2d5902800552 None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:39.600935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8ba54875-41af-4be8-b3b1-2d5902800552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:39.717287 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 690/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Sep 14 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:42.490774 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9273b-eb58-4410-844d-fab58ba249b3 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:42.491353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9273b-eb58-4410-844d-fab58ba249b3 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:42.491587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9273b-eb58-4410-844d-fab58ba249b3 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:42.493846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 724/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:18:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:42.501251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1ee31-be36-4e7f-8542-37cf3df929b0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:42.502258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1ee31-be36-4e7f-8542-37cf3df929b0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:42.502355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1ee31-be36-4e7f-8542-37cf3df929b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:42.568206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d7b1ee31-be36-4e7f-8542-37cf3df929b0 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:42.569409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d7b1ee31-be36-4e7f-8542-37cf3df929b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:42.625124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:42.669015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 691/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:42.980401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9273b-eb58-4410-844d-fab58ba249b3 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:42.982001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5fd9273b-eb58-4410-844d-fab58ba249b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:43.134661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9273b-eb58-4410-844d-fab58ba249b3 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:43.222140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:43.265106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f72df1-3c13-469d-bda4-48d984a4c874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:43.265705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f72df1-3c13-469d-bda4-48d984a4c874 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:43.265985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f72df1-3c13-469d-bda4-48d984a4c874 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:43.266253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f72df1-3c13-469d-bda4-48d984a4c874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:43.267995 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-60f72df1-3c13-469d-bda4-48d984a4c874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:43.358624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f72df1-3c13-469d-bda4-48d984a4c874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:43.360244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f72df1-3c13-469d-bda4-48d984a4c874 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:43.378851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 725/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:44.531621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f107e-00ec-445d-99a2-41f4cbb23443 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:44.532229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f107e-00ec-445d-99a2-41f4cbb23443 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:44.532229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f107e-00ec-445d-99a2-41f4cbb23443 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:44.534118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 692/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:44.540381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde411c9-60a1-49a6-9dc5-a67da6468d55 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:44.540824 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde411c9-60a1-49a6-9dc5-a67da6468d55 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:44.540917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde411c9-60a1-49a6-9dc5-a67da6468d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:44.616471 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-bde411c9-60a1-49a6-9dc5-a67da6468d55 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:44.617683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-bde411c9-60a1-49a6-9dc5-a67da6468d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:44.645226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:44.716467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 726/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:44.868600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f107e-00ec-445d-99a2-41f4cbb23443 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:44.870147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-bb9f107e-00ec-445d-99a2-41f4cbb23443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:45.024896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f107e-00ec-445d-99a2-41f4cbb23443 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:45.065962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:45.138604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94049b-ad06-4919-bf2f-dea51673d7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:45.139133 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94049b-ad06-4919-bf2f-dea51673d7e7 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:45.139415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94049b-ad06-4919-bf2f-dea51673d7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:45.139685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94049b-ad06-4919-bf2f-dea51673d7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:45.141357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5b94049b-ad06-4919-bf2f-dea51673d7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:45.242698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94049b-ad06-4919-bf2f-dea51673d7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:45.244326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94049b-ad06-4919-bf2f-dea51673d7e7 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:45.263604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 693/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:46.419949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e4802-cc7a-413e-a67a-b7c42511e265 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:46.420506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e4802-cc7a-413e-a67a-b7c42511e265 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:46.420506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e4802-cc7a-413e-a67a-b7c42511e265 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:46.421858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 727/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:46.428441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825bab1-0cb3-44d6-bd9b-f123eeaad303 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:46.428875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825bab1-0cb3-44d6-bd9b-f123eeaad303 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:46.429106 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825bab1-0cb3-44d6-bd9b-f123eeaad303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:46.483697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:46.506981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6825bab1-0cb3-44d6-bd9b-f123eeaad303 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:46.508240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6825bab1-0cb3-44d6-bd9b-f123eeaad303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:46.603915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 694/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:46.759298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e4802-cc7a-413e-a67a-b7c42511e265 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:46.760841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-e74e4802-cc7a-413e-a67a-b7c42511e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:46.912994 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e4802-cc7a-413e-a67a-b7c42511e265 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:46.925671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:47.025123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081d12c-4e58-46d7-a97f-9604243681cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:47.025511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d12c-4e58-46d7-a97f-9604243681cd service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:47.025771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d12c-4e58-46d7-a97f-9604243681cd service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:47.026032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d12c-4e58-46d7-a97f-9604243681cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:47.027622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8081d12c-4e58-46d7-a97f-9604243681cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:47.116847 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081d12c-4e58-46d7-a97f-9604243681cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:47.118417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081d12c-4e58-46d7-a97f-9604243681cd service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:47.136413 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 728/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:48.281290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54377e40-8050-4db7-8c69-e37761178af6 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:48.281773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54377e40-8050-4db7-8c69-e37761178af6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:48.281773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54377e40-8050-4db7-8c69-e37761178af6 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:48.283138 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 695/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:48.290277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1a1d-c819-40ba-b143-cc990a18a798 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:48.290778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1a1d-c819-40ba-b143-cc990a18a798 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:48.290896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1a1d-c819-40ba-b143-cc990a18a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:48.310835 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:48.367378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-b7dd1a1d-c819-40ba-b143-cc990a18a798 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:48.368627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b7dd1a1d-c819-40ba-b143-cc990a18a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:48.466305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 729/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:48.616678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54377e40-8050-4db7-8c69-e37761178af6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:48.618217 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-54377e40-8050-4db7-8c69-e37761178af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:48.729549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:48.764838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54377e40-8050-4db7-8c69-e37761178af6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:48.887129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a726d-2b0e-422e-bf82-c59afdef07d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:48.887648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a726d-2b0e-422e-bf82-c59afdef07d6 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:48.887960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a726d-2b0e-422e-bf82-c59afdef07d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:48.888231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a726d-2b0e-422e-bf82-c59afdef07d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:48.889888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8e9a726d-2b0e-422e-bf82-c59afdef07d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:48.968475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:48.982415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a726d-2b0e-422e-bf82-c59afdef07d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:48.984063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a726d-2b0e-422e-bf82-c59afdef07d6 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:49.002804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 696/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:50.118256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc427-9d8b-44db-af63-4b3bff263560 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:50.118803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc427-9d8b-44db-af63-4b3bff263560 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:50.118920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc427-9d8b-44db-af63-4b3bff263560 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:50.120259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 730/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:50.126454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c61d-eeec-46fa-95fd-8edeb3c3caad None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:50.127374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c61d-eeec-46fa-95fd-8edeb3c3caad None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:50.127528 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c61d-eeec-46fa-95fd-8edeb3c3caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:50.203821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1da2c61d-eeec-46fa-95fd-8edeb3c3caad None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:50.205663 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1da2c61d-eeec-46fa-95fd-8edeb3c3caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:50.302615 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 697/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:50.453048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fc427-9d8b-44db-af63-4b3bff263560 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:50.454583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-852fc427-9d8b-44db-af63-4b3bff263560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:50.546744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:50.609892 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fc427-9d8b-44db-af63-4b3bff263560 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:50.728403 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01552eae-6cb7-462b-8ce8-b63e2dda910f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:50.728921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552eae-6cb7-462b-8ce8-b63e2dda910f service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:50.729194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552eae-6cb7-462b-8ce8-b63e2dda910f service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:50.729475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552eae-6cb7-462b-8ce8-b63e2dda910f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:50.731104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-01552eae-6cb7-462b-8ce8-b63e2dda910f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:50.780635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:50.825567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01552eae-6cb7-462b-8ce8-b63e2dda910f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:50.827156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01552eae-6cb7-462b-8ce8-b63e2dda910f service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:50.845415 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 731/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:18:51.943250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fdd62-91db-404b-8a27-1791709ecfe1 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:51.944105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fdd62-91db-404b-8a27-1791709ecfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:51.944297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fdd62-91db-404b-8a27-1791709ecfe1 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:51.945788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 698/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:51.952324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734b17-4a8f-4d10-ad6b-25c792c6510d None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:51.952762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734b17-4a8f-4d10-ad6b-25c792c6510d None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:51.952856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734b17-4a8f-4d10-ad6b-25c792c6510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:52.029722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-7e734b17-4a8f-4d10-ad6b-25c792c6510d None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:52.030938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7e734b17-4a8f-4d10-ad6b-25c792c6510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:52.128525 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 732/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:52.278307 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fdd62-91db-404b-8a27-1791709ecfe1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:52.280055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0d3fdd62-91db-404b-8a27-1791709ecfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:52.330183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:52.427404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fdd62-91db-404b-8a27-1791709ecfe1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:52.538492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712589e-c1e6-4a99-be5a-f660cf30eb46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:52.539029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712589e-c1e6-4a99-be5a-f660cf30eb46 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:52.539306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712589e-c1e6-4a99-be5a-f660cf30eb46 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:52.539576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712589e-c1e6-4a99-be5a-f660cf30eb46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:52.541204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7712589e-c1e6-4a99-be5a-f660cf30eb46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:52.548054 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:52.632004 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712589e-c1e6-4a99-be5a-f660cf30eb46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:52.633643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712589e-c1e6-4a99-be5a-f660cf30eb46 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:52.652051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 699/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:53.726094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48356c2-bda6-4789-87f6-153d389a1a9f None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:53.726629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48356c2-bda6-4789-87f6-153d389a1a9f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:53.726629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48356c2-bda6-4789-87f6-153d389a1a9f None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:53.728037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 733/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:53.734335 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298acf8-8aab-4976-8d72-11f84284f110 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:53.734820 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298acf8-8aab-4976-8d72-11f84284f110 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:53.734920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298acf8-8aab-4976-8d72-11f84284f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:53.818125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1298acf8-8aab-4976-8d72-11f84284f110 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:53.819365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1298acf8-8aab-4976-8d72-11f84284f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:53.886539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:53.916537 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 700/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:54.068289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48356c2-bda6-4789-87f6-153d389a1a9f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:54.069826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b48356c2-bda6-4789-87f6-153d389a1a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:54.088246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:54.216601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48356c2-bda6-4789-87f6-153d389a1a9f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:54.305324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:54.330981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d9d4-1c61-423e-bfff-cc6a5ce602a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:54.331583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d9d4-1c61-423e-bfff-cc6a5ce602a7 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:54.331890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d9d4-1c61-423e-bfff-cc6a5ce602a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:54.332159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d9d4-1c61-423e-bfff-cc6a5ce602a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:54.333761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8f21d9d4-1c61-423e-bfff-cc6a5ce602a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:54.422463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d9d4-1c61-423e-bfff-cc6a5ce602a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:54.424114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d9d4-1c61-423e-bfff-cc6a5ce602a7 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:54.442573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 734/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:55.507843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f81-5a99-44ce-9dab-b67a8eea8a8e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:55.508421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f81-5a99-44ce-9dab-b67a8eea8a8e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:55.508421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f81-5a99-44ce-9dab-b67a8eea8a8e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:55.509723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 701/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:55.516134 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd40b-e1a1-4d5b-851b-624b2e3383dc None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:55.516630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd40b-e1a1-4d5b-851b-624b2e3383dc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:55.516733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd40b-e1a1-4d5b-851b-624b2e3383dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:55.594921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-139bd40b-e1a1-4d5b-851b-624b2e3383dc None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:55.596871 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-139bd40b-e1a1-4d5b-851b-624b2e3383dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:55.639356 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:55.694547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 735/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:55.852921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001f81-5a99-44ce-9dab-b67a8eea8a8e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:55.854394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-aa001f81-5a99-44ce-9dab-b67a8eea8a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:55.999235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001f81-5a99-44ce-9dab-b67a8eea8a8e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:56.054722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:56.113798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937aff4-45b1-40d6-9983-a80436a94922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:56.114323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937aff4-45b1-40d6-9983-a80436a94922 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:56.114602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937aff4-45b1-40d6-9983-a80436a94922 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:56.114870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937aff4-45b1-40d6-9983-a80436a94922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:56.116526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e937aff4-45b1-40d6-9983-a80436a94922 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:56.207631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937aff4-45b1-40d6-9983-a80436a94922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:56.209256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937aff4-45b1-40d6-9983-a80436a94922 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:56.226949 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 702/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:57.285231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ac84-b743-4c73-94ff-3c3844e6e117 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:57.285784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ac84-b743-4c73-94ff-3c3844e6e117 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:57.285913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ac84-b743-4c73-94ff-3c3844e6e117 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:57.287434 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 736/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:57.293743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1185c-4f21-46ac-b781-dcecfab148ce None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:57.294208 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1185c-4f21-46ac-b781-dcecfab148ce None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:57.294317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1185c-4f21-46ac-b781-dcecfab148ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:57.369364 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fcd1185c-4f21-46ac-b781-dcecfab148ce None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:57.370590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fcd1185c-4f21-46ac-b781-dcecfab148ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:57.372659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:57.469114 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 703/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:57.619719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ac84-b743-4c73-94ff-3c3844e6e117 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:57.621298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7345ac84-b743-4c73-94ff-3c3844e6e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:57.765096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ac84-b743-4c73-94ff-3c3844e6e117 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:57.792604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:57.879341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4735b-b05a-461d-b3e5-6fdd307a240e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:57.879888 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4735b-b05a-461d-b3e5-6fdd307a240e service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:57.880168 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4735b-b05a-461d-b3e5-6fdd307a240e service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:57.880439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4735b-b05a-461d-b3e5-6fdd307a240e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:57.882399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-20a4735b-b05a-461d-b3e5-6fdd307a240e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:57.994477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4735b-b05a-461d-b3e5-6fdd307a240e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:57.996107 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4735b-b05a-461d-b3e5-6fdd307a240e service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:58.014567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 737/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:00.070856 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d87e0-d870-48f5-af10-c2fa225aee01 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:00.071437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d87e0-d870-48f5-af10-c2fa225aee01 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:00.071437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d87e0-d870-48f5-af10-c2fa225aee01 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:00.072782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 704/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:00.078145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c557d6-44d5-450d-99be-b523024685be None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:00.078551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c557d6-44d5-450d-99be-b523024685be None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:00.078719 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c557d6-44d5-450d-99be-b523024685be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:00.120798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:00.146907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-97c557d6-44d5-450d-99be-b523024685be None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:00.148151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-97c557d6-44d5-450d-99be-b523024685be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:00.246237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 738/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:00.531857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d87e0-d870-48f5-af10-c2fa225aee01 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:00.531857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c19d87e0-d870-48f5-af10-c2fa225aee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:00.644767 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d87e0-d870-48f5-af10-c2fa225aee01 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:00.681195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:00.724015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdf2ef-dd22-4e26-9782-ee87fa94ac39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:00.724833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf2ef-dd22-4e26-9782-ee87fa94ac39 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:00.725115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf2ef-dd22-4e26-9782-ee87fa94ac39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:00.725385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf2ef-dd22-4e26-9782-ee87fa94ac39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:00.726999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d0fdf2ef-dd22-4e26-9782-ee87fa94ac39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:00.836444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdf2ef-dd22-4e26-9782-ee87fa94ac39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:00.837657 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdf2ef-dd22-4e26-9782-ee87fa94ac39 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:00.855902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 705/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:03.166306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18128550-1c3e-4310-a22d-5c632ee5ff30 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:03.166898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18128550-1c3e-4310-a22d-5c632ee5ff30 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:03.166898 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18128550-1c3e-4310-a22d-5c632ee5ff30 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:03.168305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 739/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:03.174358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1648-4d6b-47ae-9d4e-a1d73888294b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:03.174822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1648-4d6b-47ae-9d4e-a1d73888294b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:03.174921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1648-4d6b-47ae-9d4e-a1d73888294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:03.241282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-64ff1648-4d6b-47ae-9d4e-a1d73888294b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:03.242514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-64ff1648-4d6b-47ae-9d4e-a1d73888294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:03.255747 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:03.340180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 706/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:03.626242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18128550-1c3e-4310-a22d-5c632ee5ff30 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:03.627857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-18128550-1c3e-4310-a22d-5c632ee5ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:03.732393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18128550-1c3e-4310-a22d-5c632ee5ff30 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:03.745182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:03.807630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bf531-2875-4c5a-a3af-449d61caf5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:03.808286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf531-2875-4c5a-a3af-449d61caf5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:03.808565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf531-2875-4c5a-a3af-449d61caf5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:03.808837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf531-2875-4c5a-a3af-449d61caf5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:03.810442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-534bf531-2875-4c5a-a3af-449d61caf5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:03.920068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bf531-2875-4c5a-a3af-449d61caf5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:03.921509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bf531-2875-4c5a-a3af-449d61caf5ba service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:03.939317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 740/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:06.418836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472a3db-5891-4b23-8325-a14fe0dfb6ce None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:06.419411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472a3db-5891-4b23-8325-a14fe0dfb6ce None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:06.419547 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472a3db-5891-4b23-8325-a14fe0dfb6ce None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:06.421177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 707/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:06.427073 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf5b1-6242-4f19-8b72-afdee652c83c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:06.427534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf5b1-6242-4f19-8b72-afdee652c83c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:06.427642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf5b1-6242-4f19-8b72-afdee652c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:06.475386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:06.494047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-bd8bf5b1-6242-4f19-8b72-afdee652c83c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:06.495260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-bd8bf5b1-6242-4f19-8b72-afdee652c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:06.592783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 741/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:06.889365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472a3db-5891-4b23-8325-a14fe0dfb6ce None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:06.891277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e472a3db-5891-4b23-8325-a14fe0dfb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:06.996487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472a3db-5891-4b23-8325-a14fe0dfb6ce None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:07.048343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:07.083355 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ff358-26d8-40ff-9807-69dcc36ebdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:07.084003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ff358-26d8-40ff-9807-69dcc36ebdee service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:07.084286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ff358-26d8-40ff-9807-69dcc36ebdee service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:07.084558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ff358-26d8-40ff-9807-69dcc36ebdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:07.086189 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-853ff358-26d8-40ff-9807-69dcc36ebdee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:07.195829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ff358-26d8-40ff-9807-69dcc36ebdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:07.197265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ff358-26d8-40ff-9807-69dcc36ebdee service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:07.215309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 708/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:09.555031 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd394f1-94c1-48d6-a65e-9aefdacb11c5 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:09.555575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd394f1-94c1-48d6-a65e-9aefdacb11c5 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:09.555575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd394f1-94c1-48d6-a65e-9aefdacb11c5 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:09.557075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 742/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:09.562371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072444c-bb78-4756-9d56-8600fd7d5261 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:09.562805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072444c-bb78-4756-9d56-8600fd7d5261 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:09.562925 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072444c-bb78-4756-9d56-8600fd7d5261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:09.630163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5072444c-bb78-4756-9d56-8600fd7d5261 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:09.631389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5072444c-bb78-4756-9d56-8600fd7d5261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:09.651794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:09.728343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 709/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:10.017145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd394f1-94c1-48d6-a65e-9aefdacb11c5 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:10.018682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8fd394f1-94c1-48d6-a65e-9aefdacb11c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:10.124229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd394f1-94c1-48d6-a65e-9aefdacb11c5 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:10.261284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:10.319260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a615-d220-4816-ba05-7eab14a17e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:10.319895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a615-d220-4816-ba05-7eab14a17e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:10.320176 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a615-d220-4816-ba05-7eab14a17e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:10.320444 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a615-d220-4816-ba05-7eab14a17e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:10.322071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-0dc3a615-d220-4816-ba05-7eab14a17e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:10.433062 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a615-d220-4816-ba05-7eab14a17e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:10.434506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a615-d220-4816-ba05-7eab14a17e12 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:10.453070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 743/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:12.694879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399d25-d477-4dd5-9e64-c92fe2539f90 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:12.695433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399d25-d477-4dd5-9e64-c92fe2539f90 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:12.695433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399d25-d477-4dd5-9e64-c92fe2539f90 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:12.696836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 710/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:12.702117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4003-6a8b-498b-be37-24e742357ed8 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:12.702529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4003-6a8b-498b-be37-24e742357ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:12.702656 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4003-6a8b-498b-be37-24e742357ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:12.766061 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:12.769755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9efd4003-6a8b-498b-be37-24e742357ed8 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:12.771664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9efd4003-6a8b-498b-be37-24e742357ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:12.867494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 744/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:13.161440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9399d25-d477-4dd5-9e64-c92fe2539f90 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:13.162990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d9399d25-d477-4dd5-9e64-c92fe2539f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:13.265260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9399d25-d477-4dd5-9e64-c92fe2539f90 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:13.315603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:13.340526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd01f-f96c-40da-a649-31ad906116af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:13.341154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd01f-f96c-40da-a649-31ad906116af service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:13.341427 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd01f-f96c-40da-a649-31ad906116af service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:13.341692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd01f-f96c-40da-a649-31ad906116af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:13.343283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dc2bd01f-f96c-40da-a649-31ad906116af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:13.471154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd01f-f96c-40da-a649-31ad906116af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:13.472610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd01f-f96c-40da-a649-31ad906116af service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:13.490129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 711/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:15.744806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64693c90-3796-47bf-b170-b2b8cef50700 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:15.745370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64693c90-3796-47bf-b170-b2b8cef50700 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:15.745370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64693c90-3796-47bf-b170-b2b8cef50700 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:15.746720 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 745/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:15.752506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a4db-8532-480f-b95d-51f52c64543c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:15.752960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a4db-8532-480f-b95d-51f52c64543c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:15.753068 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a4db-8532-480f-b95d-51f52c64543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:15.940093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6303a4db-8532-480f-b95d-51f52c64543c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:15.941300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6303a4db-8532-480f-b95d-51f52c64543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:15.968960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:16.038580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 712/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:16.324887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64693c90-3796-47bf-b170-b2b8cef50700 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:16.326431 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-64693c90-3796-47bf-b170-b2b8cef50700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:16.434308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64693c90-3796-47bf-b170-b2b8cef50700 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:16.470467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:16.517033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea5d3-6b53-4172-8973-5fb9792c5868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:16.517634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea5d3-6b53-4172-8973-5fb9792c5868 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:16.517907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea5d3-6b53-4172-8973-5fb9792c5868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:16.518172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea5d3-6b53-4172-8973-5fb9792c5868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:16.519783 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4b4ea5d3-6b53-4172-8973-5fb9792c5868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:16.628297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea5d3-6b53-4172-8973-5fb9792c5868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:16.629725 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea5d3-6b53-4172-8973-5fb9792c5868 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:16.648446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 746/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:18.951085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e4b-c1be-4d57-a51c-53501ff7736d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:18.951694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e4b-c1be-4d57-a51c-53501ff7736d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:18.951694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e4b-c1be-4d57-a51c-53501ff7736d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:18.953050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 713/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:18.958578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89889d-8bb2-416f-815d-a7d9768877a0 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:18.959023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89889d-8bb2-416f-815d-a7d9768877a0 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:18.959125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89889d-8bb2-416f-815d-a7d9768877a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:19.025070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-5e89889d-8bb2-416f-815d-a7d9768877a0 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:19.026282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5e89889d-8bb2-416f-815d-a7d9768877a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:19.034872 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:19.123244 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 747/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:19.413621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e4b-c1be-4d57-a51c-53501ff7736d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:19.415162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-475c2e4b-c1be-4d57-a51c-53501ff7736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:19.517358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e4b-c1be-4d57-a51c-53501ff7736d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:19.574913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:19.593347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fa7e6-cca4-43c4-8cec-30c6dc31ef78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:19.593970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fa7e6-cca4-43c4-8cec-30c6dc31ef78 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:19.594246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fa7e6-cca4-43c4-8cec-30c6dc31ef78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:19.594581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fa7e6-cca4-43c4-8cec-30c6dc31ef78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:19.596753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4d3fa7e6-cca4-43c4-8cec-30c6dc31ef78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:19.707781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fa7e6-cca4-43c4-8cec-30c6dc31ef78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:19.709236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fa7e6-cca4-43c4-8cec-30c6dc31ef78 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:19.727320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 714/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:21.978223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492c18-39b8-484f-8f60-9e049de2bd90 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:21.978817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492c18-39b8-484f-8f60-9e049de2bd90 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:21.978817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492c18-39b8-484f-8f60-9e049de2bd90 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:21.980147 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 748/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:21.986186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5909-fc39-4e59-a377-3f6035929832 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:21.986630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5909-fc39-4e59-a377-3f6035929832 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:21.986751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5909-fc39-4e59-a377-3f6035929832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:22.053456 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-366e5909-fc39-4e59-a377-3f6035929832 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:22.054681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-366e5909-fc39-4e59-a377-3f6035929832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:22.092681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:22.151691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 715/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:22.450738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492c18-39b8-484f-8f60-9e049de2bd90 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:22.452393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-33492c18-39b8-484f-8f60-9e049de2bd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:22.573807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492c18-39b8-484f-8f60-9e049de2bd90 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:22.613738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:22.650556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf2df-b593-41c0-84d1-ca8e415cb014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:22.651152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf2df-b593-41c0-84d1-ca8e415cb014 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:22.651418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf2df-b593-41c0-84d1-ca8e415cb014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:22.651678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf2df-b593-41c0-84d1-ca8e415cb014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:22.653298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-1bedf2df-b593-41c0-84d1-ca8e415cb014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:22.762743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf2df-b593-41c0-84d1-ca8e415cb014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:22.764202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf2df-b593-41c0-84d1-ca8e415cb014 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:22.783490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 749/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:24.949943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e464e9-fa6c-47a9-b0ab-a7c7aa98e2e7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:24.950510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e464e9-fa6c-47a9-b0ab-a7c7aa98e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:24.950510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e464e9-fa6c-47a9-b0ab-a7c7aa98e2e7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:24.951937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 716/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:24.957199 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d5a6-246a-41e9-9d52-856e828a84e7 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:24.957636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d5a6-246a-41e9-9d52-856e828a84e7 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:24.957755 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d5a6-246a-41e9-9d52-856e828a84e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:25.024680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-90b8d5a6-246a-41e9-9d52-856e828a84e7 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:25.025895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-90b8d5a6-246a-41e9-9d52-856e828a84e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:25.044016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:25.123488 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 750/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:19:25.406601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e464e9-fa6c-47a9-b0ab-a7c7aa98e2e7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:25.408860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-26e464e9-fa6c-47a9-b0ab-a7c7aa98e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:25.511136 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e464e9-fa6c-47a9-b0ab-a7c7aa98e2e7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:25.580404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:25.587771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c60f5-b0c4-44ce-9e95-d2f061ca12b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:25.588396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c60f5-b0c4-44ce-9e95-d2f061ca12b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:25.588668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c60f5-b0c4-44ce-9e95-d2f061ca12b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:25.588933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c60f5-b0c4-44ce-9e95-d2f061ca12b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:25.590529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cb5c60f5-b0c4-44ce-9e95-d2f061ca12b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:25.698039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c60f5-b0c4-44ce-9e95-d2f061ca12b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:25.699404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c60f5-b0c4-44ce-9e95-d2f061ca12b4 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:25.717405 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 717/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:27.915086 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db13286-0a93-48b8-80c5-56f9e2ace95a None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:27.915654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db13286-0a93-48b8-80c5-56f9e2ace95a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:27.915654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db13286-0a93-48b8-80c5-56f9e2ace95a None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:27.917070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 751/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:27.922819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ff0a-aaa1-46e0-af77-24501f393ae2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:27.923266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ff0a-aaa1-46e0-af77-24501f393ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:27.923401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ff0a-aaa1-46e0-af77-24501f393ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:27.989703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6644ff0a-aaa1-46e0-af77-24501f393ae2 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:27.990922 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6644ff0a-aaa1-46e0-af77-24501f393ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:28.038520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:28.088367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 718/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:28.373740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db13286-0a93-48b8-80c5-56f9e2ace95a None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:28.375298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8db13286-0a93-48b8-80c5-56f9e2ace95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:28.477796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db13286-0a93-48b8-80c5-56f9e2ace95a None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:28.527181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:28.553401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43878e3-2b5d-4174-9937-745b9ece367a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:28.553991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43878e3-2b5d-4174-9937-745b9ece367a service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:28.554262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43878e3-2b5d-4174-9937-745b9ece367a service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:28.554534 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43878e3-2b5d-4174-9937-745b9ece367a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:28.556152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-d43878e3-2b5d-4174-9937-745b9ece367a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:28.666065 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43878e3-2b5d-4174-9937-745b9ece367a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:28.667498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43878e3-2b5d-4174-9937-745b9ece367a service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:28.685714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 752/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:38.086761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=22 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:38.683452 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=66 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:49.511010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4329f6-acc5-483e-ac32-e83ecfa7673a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:49.511680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4329f6-acc5-483e-ac32-e83ecfa7673a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:49.511680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4329f6-acc5-483e-ac32-e83ecfa7673a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:49.512964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 719/1471] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:49.518734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5befa-c01d-44b9-b128-91a3eb8c9f07 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:49.519190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5befa-c01d-44b9-b128-91a3eb8c9f07 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:49.519299 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5befa-c01d-44b9-b128-91a3eb8c9f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:49.588049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-66b5befa-c01d-44b9-b128-91a3eb8c9f07 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:49.589319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-66b5befa-c01d-44b9-b128-91a3eb8c9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:49.689127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 753/1472] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:49.990455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42b4aa-56f7-46aa-a477-f0ec0725cbee None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:49.990742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42b4aa-56f7-46aa-a477-f0ec0725cbee None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:49.991018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42b4aa-56f7-46aa-a477-f0ec0725cbee None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:49.992399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 720/1473] 10.222.0.65 () {54 vars in 966 bytes} [Wed Sep 14 15:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:49.997297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796a189-0be5-4bcd-8b21-bfe517339b4c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:49.997578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796a189-0be5-4bcd-8b21-bfe517339b4c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:49.997846 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796a189-0be5-4bcd-8b21-bfe517339b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:50.074450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-2796a189-0be5-4bcd-8b21-bfe517339b4c None None] MFA Rules not processed for user `344958332b5549558b26d199e53b8b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:50.075701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-2796a189-0be5-4bcd-8b21-bfe517339b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:50.096658 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:50.151788 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 754/1474] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Sep 14 15:19:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:50.159785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42b4aa-56f7-46aa-a477-f0ec0725cbee None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:50.161342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ba42b4aa-56f7-46aa-a477-f0ec0725cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:50.264288 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42b4aa-56f7-46aa-a477-f0ec0725cbee None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:50.338099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e7ab3-994c-4b7c-a31b-de50e87eaa7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344958332b5549558b26d199e53b8b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:50.338701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7ab3-994c-4b7c-a31b-de50e87eaa7d service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:50.338981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7ab3-994c-4b7c-a31b-de50e87eaa7d service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:50.339255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7ab3-994c-4b7c-a31b-de50e87eaa7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:50.340977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d21e7ab3-994c-4b7c-a31b-de50e87eaa7d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:50.395375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:50.451272 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e7ab3-994c-4b7c-a31b-de50e87eaa7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:50.452762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e7ab3-994c-4b7c-a31b-de50e87eaa7d service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:50.470800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 721/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:52.738311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72290-a57c-41c0-9b4b-7556cadb9869 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:52.738779 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72290-a57c-41c0-9b4b-7556cadb9869 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:52.738889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72290-a57c-41c0-9b4b-7556cadb9869 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:52.740409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 755/1476] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:52.745987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf498f6-d7ac-4477-aa18-23240e67ce22 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:52.746453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf498f6-d7ac-4477-aa18-23240e67ce22 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:52.746558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf498f6-d7ac-4477-aa18-23240e67ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:52.813492 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ebf498f6-d7ac-4477-aa18-23240e67ce22 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:52.814712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ebf498f6-d7ac-4477-aa18-23240e67ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:52.911702 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 722/1477] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:53.184401 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72290-a57c-41c0-9b4b-7556cadb9869 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:53.185848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-fff72290-a57c-41c0-9b4b-7556cadb9869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:53.312602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72290-a57c-41c0-9b4b-7556cadb9869 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:53.366873 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:53.412304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40568cb1-c78f-49e4-a7e2-9b26319f5988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:53.412905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40568cb1-c78f-49e4-a7e2-9b26319f5988 admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:53.413181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40568cb1-c78f-49e4-a7e2-9b26319f5988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:53.413449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40568cb1-c78f-49e4-a7e2-9b26319f5988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:53.414341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40568cb1-c78f-49e4-a7e2-9b26319f5988 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:53.415793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-40568cb1-c78f-49e4-a7e2-9b26319f5988 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:19:53.415793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:19:53.415793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:19:53.416937 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40568cb1-c78f-49e4-a7e2-9b26319f5988 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:53.436336 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 756/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Sep 14 15:19:53 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:19:55.637329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c186d-b4a1-46be-afad-3bad4e095593 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:55.637864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c186d-b4a1-46be-afad-3bad4e095593 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:55.637864 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c186d-b4a1-46be-afad-3bad4e095593 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:55.639264 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 723/1479] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:55.644625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a574-2625-4ea5-9e4c-17f3eb478157 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:55.645042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a574-2625-4ea5-9e4c-17f3eb478157 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:55.645171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a574-2625-4ea5-9e4c-17f3eb478157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:55.711209 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-33b2a574-2625-4ea5-9e4c-17f3eb478157 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:55.712437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-33b2a574-2625-4ea5-9e4c-17f3eb478157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:55.813800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 757/1480] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:56.109919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c186d-b4a1-46be-afad-3bad4e095593 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:56.111622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5d0c186d-b4a1-46be-afad-3bad4e095593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:56.121579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:56.262279 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c186d-b4a1-46be-afad-3bad4e095593 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:56.342125 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:56.375329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27ee62-d2b8-41ce-95eb-a95e742b06b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:56.375884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27ee62-d2b8-41ce-95eb-a95e742b06b8 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:56.376166 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27ee62-d2b8-41ce-95eb-a95e742b06b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:56.376436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27ee62-d2b8-41ce-95eb-a95e742b06b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:56.378044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3d27ee62-d2b8-41ce-95eb-a95e742b06b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:56.470848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27ee62-d2b8-41ce-95eb-a95e742b06b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:56.472556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27ee62-d2b8-41ce-95eb-a95e742b06b8 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:56.490121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 724/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:58.849981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4c4d-c3db-4c3d-8b3e-46958f039968 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:58.850569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4c4d-c3db-4c3d-8b3e-46958f039968 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:58.850569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4c4d-c3db-4c3d-8b3e-46958f039968 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:58.851930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 758/1482] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:58.857360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c50c2-b2b2-4d9a-9172-f1f4bb6c1745 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:58.857801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c50c2-b2b2-4d9a-9172-f1f4bb6c1745 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:58.857902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c50c2-b2b2-4d9a-9172-f1f4bb6c1745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:58.927309 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d86c50c2-b2b2-4d9a-9172-f1f4bb6c1745 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:58.928590 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d86c50c2-b2b2-4d9a-9172-f1f4bb6c1745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:58.974343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:59.024643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 725/1483] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:19:59.318979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4c4d-c3db-4c3d-8b3e-46958f039968 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:59.320573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ba8b4c4d-c3db-4c3d-8b3e-46958f039968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:59.345449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:59.426093 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4c4d-c3db-4c3d-8b3e-46958f039968 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:59.500940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22755bc0-9598-416d-82d3-7f5cbc784a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:59.501544 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22755bc0-9598-416d-82d3-7f5cbc784a8a service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:59.501817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22755bc0-9598-416d-82d3-7f5cbc784a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:59.502083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22755bc0-9598-416d-82d3-7f5cbc784a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:59.503682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-22755bc0-9598-416d-82d3-7f5cbc784a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:59.578712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:59.614184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22755bc0-9598-416d-82d3-7f5cbc784a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:59.615626 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22755bc0-9598-416d-82d3-7f5cbc784a8a service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:59.639354 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 759/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:01.868044 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe986-e766-4d61-b8eb-8d37bcc97084 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:01.868565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe986-e766-4d61-b8eb-8d37bcc97084 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:01.868565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe986-e766-4d61-b8eb-8d37bcc97084 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:01.869897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 726/1485] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:01.875569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6527e7a-9cf9-443b-86a2-fafe944fb876 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:01.876039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6527e7a-9cf9-443b-86a2-fafe944fb876 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:01.876144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6527e7a-9cf9-443b-86a2-fafe944fb876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:01.942884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-e6527e7a-9cf9-443b-86a2-fafe944fb876 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:01.944143 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-e6527e7a-9cf9-443b-86a2-fafe944fb876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:02.040913 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 760/1486] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:02.326216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe986-e766-4d61-b8eb-8d37bcc97084 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:02.327800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-232fe986-e766-4d61-b8eb-8d37bcc97084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:02.432304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe986-e766-4d61-b8eb-8d37bcc97084 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:02.505183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:02.506890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf927f33-4919-461e-93a0-4a9b9008b508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:02.507669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf927f33-4919-461e-93a0-4a9b9008b508 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:02.508207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf927f33-4919-461e-93a0-4a9b9008b508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:02.508503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf927f33-4919-461e-93a0-4a9b9008b508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:02.510515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cf927f33-4919-461e-93a0-4a9b9008b508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:02.618639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf927f33-4919-461e-93a0-4a9b9008b508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:02.620121 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf927f33-4919-461e-93a0-4a9b9008b508 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:02.638449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 727/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:04.953343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e77e-6591-40e9-ade8-2858bd7e9547 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:04.953903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e77e-6591-40e9-ade8-2858bd7e9547 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:04.953903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e77e-6591-40e9-ade8-2858bd7e9547 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:04.955271 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 761/1488] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:04.960748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ec18-0204-46bd-89fc-4e436e594e4f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:04.961180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ec18-0204-46bd-89fc-4e436e594e4f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:04.961378 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ec18-0204-46bd-89fc-4e436e594e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:05.027351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5760ec18-0204-46bd-89fc-4e436e594e4f None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:05.028584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5760ec18-0204-46bd-89fc-4e436e594e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:05.081619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:05.128654 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 728/1489] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:05.421385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e77e-6591-40e9-ade8-2858bd7e9547 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:05.422936 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ebc2e77e-6591-40e9-ade8-2858bd7e9547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:05.459582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:05.528646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e77e-6591-40e9-ade8-2858bd7e9547 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:05.604591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555990ec-be8e-4fba-aec5-292f7b8d9177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:05.605231 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555990ec-be8e-4fba-aec5-292f7b8d9177 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:05.605505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555990ec-be8e-4fba-aec5-292f7b8d9177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:05.605773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555990ec-be8e-4fba-aec5-292f7b8d9177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:05.607376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-555990ec-be8e-4fba-aec5-292f7b8d9177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:05.688318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:05.717809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555990ec-be8e-4fba-aec5-292f7b8d9177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:05.719262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555990ec-be8e-4fba-aec5-292f7b8d9177 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:05.737763 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 762/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:08.124600 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe15cd4-b5f0-4ff2-8c28-856abcb12ec1 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:08.125190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe15cd4-b5f0-4ff2-8c28-856abcb12ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:08.125190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe15cd4-b5f0-4ff2-8c28-856abcb12ec1 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:08.126533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 729/1491] 10.222.0.65 () {54 vars in 927 bytes} [Wed Sep 14 15:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:08.131954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f701a0-6274-4bcc-87c5-71237b6f0230 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:08.132366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f701a0-6274-4bcc-87c5-71237b6f0230 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:08.132478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f701a0-6274-4bcc-87c5-71237b6f0230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:08.197099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-43f701a0-6274-4bcc-87c5-71237b6f0230 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:08.198294 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-43f701a0-6274-4bcc-87c5-71237b6f0230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:08.300150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 763/1492] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Sep 14 15:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:08.589387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe15cd4-b5f0-4ff2-8c28-856abcb12ec1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:08.590974 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dfe15cd4-b5f0-4ff2-8c28-856abcb12ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:08.697388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe15cd4-b5f0-4ff2-8c28-856abcb12ec1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:08.784647 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bff2f-c335-49bc-9214-ae9729eb9c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:08.785253 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bff2f-c335-49bc-9214-ae9729eb9c49 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:08.785529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bff2f-c335-49bc-9214-ae9729eb9c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:08.785803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bff2f-c335-49bc-9214-ae9729eb9c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:08.787422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7d5bff2f-c335-49bc-9214-ae9729eb9c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:08.796371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:08.898704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bff2f-c335-49bc-9214-ae9729eb9c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:08.900158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bff2f-c335-49bc-9214-ae9729eb9c49 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:08.918639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 730/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:18.298699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=82 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:18.916373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=50 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:24.132708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:24.133310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:24.133310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:24.210057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:24.211270 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:24.309772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 764/1494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:24.317809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371139c-863c-41ea-aca4-aecaa703d96b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:24.318319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371139c-863c-41ea-aca4-aecaa703d96b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:24.318436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371139c-863c-41ea-aca4-aecaa703d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:24.393784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9371139c-863c-41ea-aca4-aecaa703d96b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:24.394907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9371139c-863c-41ea-aca4-aecaa703d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:24.491863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 731/1495] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:24.496672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:24.497874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:24.509215 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717cbd-d585-42f1-8880-58c219eb22ef None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:24.570222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:24.604980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:24.605607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:24.606671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:24.606979 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:24.607695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:21:24.608015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:24.609761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:24.609761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:21:24.609761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:21:24.611441 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:24.625146 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 765/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Sep 14 15:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:21:24.633475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371139c-863c-41ea-aca4-aecaa703d96b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:24.643037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371139c-863c-41ea-aca4-aecaa703d96b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:24.704236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:24.738554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:24.739153 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:24.739428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:24.739697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:24.740370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:24.742113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING py.warnings [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:24.742113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: warnings.warn(msg) Sep 14 15:21:24.742113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: Sep 14 15:21:24.743302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:24.799957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 732/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Sep 14 15:21:24 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:21:24.804115 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:24.805687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:24.840775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904650c0-56fa-4d72-93a1-2b0c955de1b3 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:24.936558 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:24.937160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:24.937433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:24.937698 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:24.938337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:24.939341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:24.939341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:21:24.939341 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:21:24.940586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:24.984137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 766/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:21:24 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:21:24.988620 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:24.990301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:25.052916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dbeb3-1186-4eb3-b2f7-e99ea0d15018 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:25.135681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:25.147040 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:25.147643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:25.147956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:25.148224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:25.148860 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:25.149875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING py.warnings [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:25.149875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: warnings.warn(msg) Sep 14 15:21:25.149875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: Sep 14 15:21:25.150754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:25.163306 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 733/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:21:25.167596 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:25.169171 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:25.180630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009caf-5479-44ce-8aea-12f680535a54 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:25.207628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:25.281521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33849012-ab39-41d5-b6b2-f669a183ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:25.282110 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849012-ab39-41d5-b6b2-f669a183ecfa admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:25.282479 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849012-ab39-41d5-b6b2-f669a183ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:25.282862 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849012-ab39-41d5-b6b2-f669a183ecfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:25.283712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33849012-ab39-41d5-b6b2-f669a183ecfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:25.285009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-33849012-ab39-41d5-b6b2-f669a183ecfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:25.285009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:21:25.285009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:21:25.286007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33849012-ab39-41d5-b6b2-f669a183ecfa admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:25.299511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 767/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:21:25.304049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:25.305602 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:25.340682 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54534da-ad35-4ae1-ad0b-79727ebba0b9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:25.434508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe138c8d-1023-49b7-a4ef-bc70355cd69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:25.435155 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe138c8d-1023-49b7-a4ef-bc70355cd69e admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:25.435425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe138c8d-1023-49b7-a4ef-bc70355cd69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:25.435687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe138c8d-1023-49b7-a4ef-bc70355cd69e admin admin] PATH_INFO: `/v3/projects/8088c5ba8ae64592bb6a6d1bfc2da954/users/107f3452ed6244359139bc20b0f35db7/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:25.458218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe138c8d-1023-49b7-a4ef-bc70355cd69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8088c5ba8ae64592bb6a6d1bfc2da954, user_id=107f3452ed6244359139bc20b0f35db7, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:25.459239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING py.warnings [None req-fe138c8d-1023-49b7-a4ef-bc70355cd69e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:25.459239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: warnings.warn(msg) Sep 14 15:21:25.459239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: Sep 14 15:21:25.461198 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe138c8d-1023-49b7-a4ef-bc70355cd69e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:25.484875 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 734/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Sep 14 15:21:25 2022] PUT /identity/v3/projects/8088c5ba8ae64592bb6a6d1bfc2da954/users/107f3452ed6244359139bc20b0f35db7/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:21:25.497641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10951-bb1f-4ad5-8710-87e7a522039a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:25.497926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10951-bb1f-4ad5-8710-87e7a522039a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:25.498195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10951-bb1f-4ad5-8710-87e7a522039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:25.556542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-62b10951-bb1f-4ad5-8710-87e7a522039a None None] MFA Rules not processed for user `107f3452ed6244359139bc20b0f35db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:25.557640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-62b10951-bb1f-4ad5-8710-87e7a522039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:25.637320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 768/1502] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:25.650515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396ef72-2af8-44d7-9b0c-66afa5bebc48 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:25.650797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396ef72-2af8-44d7-9b0c-66afa5bebc48 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:25.651067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396ef72-2af8-44d7-9b0c-66afa5bebc48 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:25.652435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 735/1503] 10.222.0.65 () {54 vars in 964 bytes} [Wed Sep 14 15:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:25.657398 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2de9-dcfe-4a42-8168-b50e280cf8f8 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:25.657683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2de9-dcfe-4a42-8168-b50e280cf8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:25.657959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2de9-dcfe-4a42-8168-b50e280cf8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:25.690103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:25.734223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-f61d2de9-dcfe-4a42-8168-b50e280cf8f8 None None] MFA Rules not processed for user `8d4b2587bd2c4c5f9e3b8d678432d54b`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:25.735435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-f61d2de9-dcfe-4a42-8168-b50e280cf8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:25.813961 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 769/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Sep 14 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:25.821825 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396ef72-2af8-44d7-9b0c-66afa5bebc48 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:25.823360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3396ef72-2af8-44d7-9b0c-66afa5bebc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:25.873458 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:25.932889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396ef72-2af8-44d7-9b0c-66afa5bebc48 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:26.012365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d4b2587bd2c4c5f9e3b8d678432d54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:26.012977 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:26.013249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:26.013512 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:26.015111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:26.112822 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:26.114203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:26.117809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:26.132948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 736/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:26.180032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2542ef-8156-41de-bb46-34f0b9c9d590 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:26.180463 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2542ef-8156-41de-bb46-34f0b9c9d590 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:26.180585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2542ef-8156-41de-bb46-34f0b9c9d590 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:26.181861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 770/1506] 10.222.0.65 () {52 vars in 830 bytes} [Wed Sep 14 15:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:26.185746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:26.187037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:26.295332 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1641c4-5df9-4440-9b7a-36224e514819 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:26.390120 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:26.390797 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:26.390921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:26.391177 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] PATH_INFO: `/v3/users/107f3452ed6244359139bc20b0f35db7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:26.403972 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107f3452ed6244359139bc20b0f35db7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:26.405263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING py.warnings [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:26.405263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: warnings.warn(msg) Sep 14 15:21:26.405263 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: Sep 14 15:21:26.406482 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:26.416687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:26.478020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107f3452ed6244359139bc20b0f35db7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:26.492150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107f3452ed6244359139bc20b0f35db7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:26.501433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107f3452ed6244359139bc20b0f35db7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:26.524800 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107f3452ed6244359139bc20b0f35db7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:26.525353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107f3452ed6244359139bc20b0f35db7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:26.531699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 737/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Sep 14 15:21:26 2022] DELETE /identity/v3/users/107f3452ed6244359139bc20b0f35db7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:21:26.536181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:26.536464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:26.536736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:26.594097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:26.595345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:26.670734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:26.683683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 771/1508] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:26.693915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:26.695149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:26.795020 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249e98-4b5d-4884-b391-831c45460928 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:26.849711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:26.870542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949cd19-c4f0-4ac4-87e8-e8648a863745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:26.871152 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cd19-c4f0-4ac4-87e8-e8648a863745 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:26.871960 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cd19-c4f0-4ac4-87e8-e8648a863745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:26.872240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cd19-c4f0-4ac4-87e8-e8648a863745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:26.873839 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4949cd19-c4f0-4ac4-87e8-e8648a863745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:26.984802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949cd19-c4f0-4ac4-87e8-e8648a863745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:26.986157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949cd19-c4f0-4ac4-87e8-e8648a863745 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:27.004609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 738/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:27.331556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:27.332813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:27.344817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f8a0-2d0e-4d40-b707-af2d7c0c4cab None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:27.442565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:27.443192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:27.443465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:27.443734 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] PATH_INFO: `/v3/projects/8088c5ba8ae64592bb6a6d1bfc2da954` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:27.454305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8088c5ba8ae64592bb6a6d1bfc2da954)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:27.455330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:27.455330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:21:27.455330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:21:27.456564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:27.515448 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8088c5ba8ae64592bb6a6d1bfc2da954', 'request_id': 'req-2d6a4820-749b-405f-ab8f-e5565487f132'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:27.529859 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8088c5ba8ae64592bb6a6d1bfc2da954', 'request_id': 'req-2d6a4820-749b-405f-ab8f-e5565487f132'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:27.536116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8088c5ba8ae64592bb6a6d1bfc2da954', 'request_id': 'req-2d6a4820-749b-405f-ab8f-e5565487f132'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:27.562127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] The token cache is being invalidate because project 8088c5ba8ae64592bb6a6d1bfc2da954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:21:27.562414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:27.562934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-2d6a4820-749b-405f-ab8f-e5565487f132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:21:27.564281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 772/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Sep 14 15:21:27 2022] DELETE /identity/v3/projects/8088c5ba8ae64592bb6a6d1bfc2da954 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:21:37.002317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=62 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:37.560117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:22:43.198041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569e2e6-20ff-4c9d-b33c-c50585816ea7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:43.198676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569e2e6-20ff-4c9d-b33c-c50585816ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:43.198676 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569e2e6-20ff-4c9d-b33c-c50585816ea7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:43.200015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 739/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:22:43.204891 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58b8d-aa7d-40cc-a7fc-3c39fdca933b None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:43.205305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58b8d-aa7d-40cc-a7fc-3c39fdca933b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:43.205433 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58b8d-aa7d-40cc-a7fc-3c39fdca933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:43.297722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-5aa58b8d-aa7d-40cc-a7fc-3c39fdca933b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:43.299469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5aa58b8d-aa7d-40cc-a7fc-3c39fdca933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:43.405511 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 773/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:43.562331 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569e2e6-20ff-4c9d-b33c-c50585816ea7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:43.564642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3569e2e6-20ff-4c9d-b33c-c50585816ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:43.695691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569e2e6-20ff-4c9d-b33c-c50585816ea7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:43.701533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a2fb7-036f-4ab2-b88f-56eb17cc8294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:43.702144 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a2fb7-036f-4ab2-b88f-56eb17cc8294 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:43.702426 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a2fb7-036f-4ab2-b88f-56eb17cc8294 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:43.702699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a2fb7-036f-4ab2-b88f-56eb17cc8294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:43.711766 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a2fb7-036f-4ab2-b88f-56eb17cc8294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:43.713380 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a2fb7-036f-4ab2-b88f-56eb17cc8294 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:43.724149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 740/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:22:44.813916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af616-2267-4ed4-ac20-3acd6b7a456b None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:44.815033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af616-2267-4ed4-ac20-3acd6b7a456b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:44.815033 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af616-2267-4ed4-ac20-3acd6b7a456b None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:44.816606 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 774/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:22:44.824104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db49dd-4daf-4939-9816-512b021830c2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:44.824674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db49dd-4daf-4939-9816-512b021830c2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:44.824674 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db49dd-4daf-4939-9816-512b021830c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:44.845009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e1db49dd-4daf-4939-9816-512b021830c2 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:44.846876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e1db49dd-4daf-4939-9816-512b021830c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:44.855021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 741/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:22:45.006095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af616-2267-4ed4-ac20-3acd6b7a456b None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:45.021376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af616-2267-4ed4-ac20-3acd6b7a456b None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:45.026804 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf904d-0fbd-43ec-a1f1-8251a0a2f98c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:45.027394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf904d-0fbd-43ec-a1f1-8251a0a2f98c service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:45.027691 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf904d-0fbd-43ec-a1f1-8251a0a2f98c service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:45.027993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf904d-0fbd-43ec-a1f1-8251a0a2f98c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:45.037071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf904d-0fbd-43ec-a1f1-8251a0a2f98c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:45.038640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf904d-0fbd-43ec-a1f1-8251a0a2f98c service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:45.047826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 775/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:22:47.391598 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a14dda-271c-47d6-bec2-cc6a5ede03eb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:47.392327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a14dda-271c-47d6-bec2-cc6a5ede03eb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:47.392327 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a14dda-271c-47d6-bec2-cc6a5ede03eb None None] PATH_INFO: `/v3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:47.393455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 742/1517] 10.222.0.33 () {54 vars in 925 bytes} [Wed Sep 14 15:22:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:22:47.399843 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb887e3-52d7-4dc5-a293-af9bbf59f6dd None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:47.400250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb887e3-52d7-4dc5-a293-af9bbf59f6dd None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:47.400422 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb887e3-52d7-4dc5-a293-af9bbf59f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:47.461035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-abb887e3-52d7-4dc5-a293-af9bbf59f6dd None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:47.462352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-abb887e3-52d7-4dc5-a293-af9bbf59f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:47.479592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:22:47.535786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 776/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Sep 14 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:54.839988 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=56 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:22:56.260805 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324d4e-1915-42d9-8672-649a907d95da None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.261390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324d4e-1915-42d9-8672-649a907d95da None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.261390 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324d4e-1915-42d9-8672-649a907d95da None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.262880 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 743/1519] 10.222.0.65 () {54 vars in 961 bytes} [Wed Sep 14 15:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:22:56.268515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722873-f6a7-4f10-992a-47ad0d84596a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.268998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722873-f6a7-4f10-992a-47ad0d84596a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.269108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722873-f6a7-4f10-992a-47ad0d84596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.291707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4d722873-f6a7-4f10-992a-47ad0d84596a None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:56.292934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4d722873-f6a7-4f10-992a-47ad0d84596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:56.302703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 777/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Sep 14 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:56.310428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324d4e-1915-42d9-8672-649a907d95da None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.324396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324d4e-1915-42d9-8672-649a907d95da None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.329247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797271c-455e-457d-afdb-22338dce9f6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05057b8842ea4cf88ba987b913308cd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.329838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797271c-455e-457d-afdb-22338dce9f6c service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.330111 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797271c-455e-457d-afdb-22338dce9f6c service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.330384 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797271c-455e-457d-afdb-22338dce9f6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.338592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797271c-455e-457d-afdb-22338dce9f6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.340213 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797271c-455e-457d-afdb-22338dce9f6c service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.350735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 744/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:22:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:22:56.547042 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8637-a5dc-4a43-a052-c7473094bd67 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.547276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8637-a5dc-4a43-a052-c7473094bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.547580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8637-a5dc-4a43-a052-c7473094bd67 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.549014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 778/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:22:56.555239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e47b8-0687-4757-898a-7e6bbf2068d1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.555521 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e47b8-0687-4757-898a-7e6bbf2068d1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.555833 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e47b8-0687-4757-898a-7e6bbf2068d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.575223 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f21e47b8-0687-4757-898a-7e6bbf2068d1 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:56.576451 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f21e47b8-0687-4757-898a-7e6bbf2068d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:56.584695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 745/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:56.738992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e8637-a5dc-4a43-a052-c7473094bd67 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.756180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e8637-a5dc-4a43-a052-c7473094bd67 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.761772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6031d3-0154-4f84-9609-01857c45bc81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.762404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6031d3-0154-4f84-9609-01857c45bc81 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.762678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6031d3-0154-4f84-9609-01857c45bc81 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.762947 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6031d3-0154-4f84-9609-01857c45bc81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.771776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6031d3-0154-4f84-9609-01857c45bc81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.773375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6031d3-0154-4f84-9609-01857c45bc81 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.783216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 779/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:22:57.876526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929026a-6282-4d49-bd56-93fa968985cb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.877085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929026a-6282-4d49-bd56-93fa968985cb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.877085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929026a-6282-4d49-bd56-93fa968985cb None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.878884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 746/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:22:57.885095 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7994-2a62-45ee-b681-81a62583aa6c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.885556 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7994-2a62-45ee-b681-81a62583aa6c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.885662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7994-2a62-45ee-b681-81a62583aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.907052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-b0ab7994-2a62-45ee-b681-81a62583aa6c None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:57.908282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b0ab7994-2a62-45ee-b681-81a62583aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:57.916212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 780/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:58.073751 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929026a-6282-4d49-bd56-93fa968985cb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:58.088041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929026a-6282-4d49-bd56-93fa968985cb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:58.093723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50e3e6-8447-4f12-a091-da2810b4b7f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:58.094541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50e3e6-8447-4f12-a091-da2810b4b7f5 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:58.094837 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50e3e6-8447-4f12-a091-da2810b4b7f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:58.095104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50e3e6-8447-4f12-a091-da2810b4b7f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:58.103241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50e3e6-8447-4f12-a091-da2810b4b7f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:58.104829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50e3e6-8447-4f12-a091-da2810b4b7f5 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:58.114707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 747/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:23:02.216289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dc177-63ec-4b2b-be62-0df06a402cc0 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:02.216869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dc177-63ec-4b2b-be62-0df06a402cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:02.216869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dc177-63ec-4b2b-be62-0df06a402cc0 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:02.218188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 781/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:23:02.224041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c450-d34d-400a-9277-7f43e52bb0b0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:02.224498 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c450-d34d-400a-9277-7f43e52bb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:02.224609 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c450-d34d-400a-9277-7f43e52bb0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:02.244389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-4a08c450-d34d-400a-9277-7f43e52bb0b0 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:23:02.245601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4a08c450-d34d-400a-9277-7f43e52bb0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:23:02.253517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 748/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:23:02.543228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dc177-63ec-4b2b-be62-0df06a402cc0 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:23:02.544963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9e2dc177-63ec-4b2b-be62-0df06a402cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:23:02.622957 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dc177-63ec-4b2b-be62-0df06a402cc0 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:23:02.626554 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ee7a5-c5ea-4bf1-9e43-346425d7b41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:23:02.627127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ee7a5-c5ea-4bf1-9e43-346425d7b41d service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:02.627399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ee7a5-c5ea-4bf1-9e43-346425d7b41d service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:02.627664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ee7a5-c5ea-4bf1-9e43-346425d7b41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:02.636819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ee7a5-c5ea-4bf1-9e43-346425d7b41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:23:02.638237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ee7a5-c5ea-4bf1-9e43-346425d7b41d service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:23:02.648211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 782/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:23:04.833910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c000b-427b-48db-bf24-0dcfd512af61 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:04.834514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c000b-427b-48db-bf24-0dcfd512af61 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:04.834514 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c000b-427b-48db-bf24-0dcfd512af61 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:04.835828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 749/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:23:04.841216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba521-b775-4d9a-9c6b-7a2c80e0da4b None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:04.841669 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba521-b775-4d9a-9c6b-7a2c80e0da4b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:04.841785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba521-b775-4d9a-9c6b-7a2c80e0da4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:04.861416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-75cba521-b775-4d9a-9c6b-7a2c80e0da4b None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:23:04.863083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-75cba521-b775-4d9a-9c6b-7a2c80e0da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:23:04.870807 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 783/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:23:05.159548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c000b-427b-48db-bf24-0dcfd512af61 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:23:05.170239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c000b-427b-48db-bf24-0dcfd512af61 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:23:05.173781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256682-94f1-4d0d-bfc3-bc02a697499a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:23:05.174365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256682-94f1-4d0d-bfc3-bc02a697499a service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:05.174641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256682-94f1-4d0d-bfc3-bc02a697499a service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:05.175506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256682-94f1-4d0d-bfc3-bc02a697499a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:05.184276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256682-94f1-4d0d-bfc3-bc02a697499a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:23:05.185697 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256682-94f1-4d0d-bfc3-bc02a697499a service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:23:05.194997 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 750/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:23:09.129191 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a0fa-8c63-4202-909c-21a7bc39a083 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:09.129784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a0fa-8c63-4202-909c-21a7bc39a083 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:09.129784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a0fa-8c63-4202-909c-21a7bc39a083 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:09.131081 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 784/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:23:09.136334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81283d-227a-4ab9-af60-e864f03141dc None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:09.136834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81283d-227a-4ab9-af60-e864f03141dc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:09.136948 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81283d-227a-4ab9-af60-e864f03141dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:09.157084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3c81283d-227a-4ab9-af60-e864f03141dc None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:23:09.158280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3c81283d-227a-4ab9-af60-e864f03141dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:23:09.166181 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 751/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:23:09.471003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a0fa-8c63-4202-909c-21a7bc39a083 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:23:09.472704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-24e1a0fa-8c63-4202-909c-21a7bc39a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:23:09.538662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:23:09.555816 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a0fa-8c63-4202-909c-21a7bc39a083 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:23:09.559430 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a2633-fb8c-4470-91a9-d7e6a90e758f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d4b2587bd2c4c5f9e3b8d678432d54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:23:09.560056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a2633-fb8c-4470-91a9-d7e6a90e758f service cinder] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:09.560337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a2633-fb8c-4470-91a9-d7e6a90e758f service cinder] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:09.560610 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a2633-fb8c-4470-91a9-d7e6a90e758f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:09.570090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a2633-fb8c-4470-91a9-d7e6a90e758f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:23:09.571504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a2633-fb8c-4470-91a9-d7e6a90e758f service cinder] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:23:09.581464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 785/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:23:11.712562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c8f8-2151-4b21-93a6-2b6131096d80 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:11.713186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c8f8-2151-4b21-93a6-2b6131096d80 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:11.713186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c8f8-2151-4b21-93a6-2b6131096d80 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:11.714659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 752/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:23:11.720193 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac706fa-e9fb-488d-9c55-18999f46f8ba None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:11.720710 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac706fa-e9fb-488d-9c55-18999f46f8ba None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:11.720813 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac706fa-e9fb-488d-9c55-18999f46f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:11.740903 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-aac706fa-e9fb-488d-9c55-18999f46f8ba None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:23:11.742122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-aac706fa-e9fb-488d-9c55-18999f46f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:23:11.750630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 786/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:23:12.051959 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c8f8-2151-4b21-93a6-2b6131096d80 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:23:12.053664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8195c8f8-2151-4b21-93a6-2b6131096d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:23:12.066517 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c8f8-2151-4b21-93a6-2b6131096d80 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:23:12.070027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b7302-c703-4cb5-81c7-dea077bd7505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d4b2587bd2c4c5f9e3b8d678432d54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:23:12.070618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b7302-c703-4cb5-81c7-dea077bd7505 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:23:12.070895 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b7302-c703-4cb5-81c7-dea077bd7505 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:23:12.071169 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b7302-c703-4cb5-81c7-dea077bd7505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:23:12.080119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b7302-c703-4cb5-81c7-dea077bd7505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:23:12.081541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b7302-c703-4cb5-81c7-dea077bd7505 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:23:12.091196 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 753/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:23:21.735265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=11 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:23:22.086879 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=33 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:31.501396 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64242-7e8d-453a-8d09-6a9c91cb21d1 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.502507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64242-7e8d-453a-8d09-6a9c91cb21d1 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.502507 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64242-7e8d-453a-8d09-6a9c91cb21d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.512990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e2c1-b7ec-416d-9f66-2513e1cb0f86 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.513536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e2c1-b7ec-416d-9f66-2513e1cb0f86 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.513536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e2c1-b7ec-416d-9f66-2513e1cb0f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.523239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-39b64242-7e8d-453a-8d09-6a9c91cb21d1 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:31.524587 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-39b64242-7e8d-453a-8d09-6a9c91cb21d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:31.533428 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5d69e2c1-b7ec-416d-9f66-2513e1cb0f86 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:31.534971 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5d69e2c1-b7ec-416d-9f66-2513e1cb0f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:31.535090 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 787/1540] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:31.541842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567210ff-f8c6-4860-bac1-91b4d3ab1a3a None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.542122 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567210ff-f8c6-4860-bac1-91b4d3ab1a3a None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.542395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567210ff-f8c6-4860-bac1-91b4d3ab1a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.542924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 754/1541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:24:31.550643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6b4f-9953-4f59-bff3-a5f57925dd2a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.550926 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6b4f-9953-4f59-bff3-a5f57925dd2a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.551203 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6b4f-9953-4f59-bff3-a5f57925dd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.561831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-567210ff-f8c6-4860-bac1-91b4d3ab1a3a None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:31.563016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-567210ff-f8c6-4860-bac1-91b4d3ab1a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:31.570692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b4db6b4f-9953-4f59-bff3-a5f57925dd2a None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:31.571465 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 788/1542] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:24:31.571954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b4db6b4f-9953-4f59-bff3-a5f57925dd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:31.576053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567210ff-f8c6-4860-bac1-91b4d3ab1a3a None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.579801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 755/1543] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:24:31.584687 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6b4f-9953-4f59-bff3-a5f57925dd2a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.586055 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567210ff-f8c6-4860-bac1-91b4d3ab1a3a None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.590575 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.591163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.591436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.591704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.592374 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:24:31.592673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.593646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6b4f-9953-4f59-bff3-a5f57925dd2a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.594254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.600851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.602043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.602329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.602603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.603622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:24:31.603622 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.604707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING py.warnings [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:24:31.604707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: warnings.warn(msg) Sep 14 15:24:31.604707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: Sep 14 15:24:31.605520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.606844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 789/1544] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Sep 14 15:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:24:31.615385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.621129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 756/1545] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Sep 14 15:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:24:31.625388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa228-7c93-481e-bc50-c344f67934f8 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.629607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.630604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.631201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.631475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.631743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.632513 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.633519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:24:31.633519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:24:31.633519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:24:31.634701 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.640817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2a9af-fd71-4499-8ac0-d2c52085721e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.646683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.647289 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.647571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.647874 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.648527 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.650438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.679642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 790/1546] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:24:31.683612 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 757/1547] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:24:31.684778 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.686036 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.748991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17450be1-84ac-4bbf-9008-bbd16c042708 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.749931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a859d9c-0862-4bdc-b072-a58e9b97a843 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.754454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.755018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.755285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.755407 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.755560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.756027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.756234 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.756412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.756579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.757170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.758157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING py.warnings [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:24:31.758157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: warnings.warn(msg) Sep 14 15:24:31.758157 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: Sep 14 15:24:31.758402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.759346 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.781241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 791/1548] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:24:31.782771 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 758/1549] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:24:31.785705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.786765 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.797605 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0bf86-48fd-4dfe-8060-49ba9fa6c42a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.801966 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bcbd-9bb1-4356-9765-fd56e1015792 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.802823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.803423 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.803705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.804027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.804649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.806241 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.807047 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.807672 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.808013 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.808403 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.809056 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.810683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.817323 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 759/1550] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:31.821301 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.824733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 792/1551] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:31.825705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.831319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336426f1-4d48-4dfd-8f36-182ac7b3425a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.835640 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b49b7-72e5-4172-b464-2c764fdeb900 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.836130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.836753 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.837032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.837304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.837941 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.839533 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.840412 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.841174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.841454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.842084 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.842718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.844324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.851714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 760/1552] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:31.855015 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 793/1553] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:31.855889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.858910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:31.866447 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562426-0009-4e50-9195-cb1506e90215 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.869071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c574c-f2ed-4b3c-b149-56c51c204416 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:31.871124 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797bcd1-51f3-458d-aaa4-227ead315b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.871772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797bcd1-51f3-458d-aaa4-227ead315b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.872077 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797bcd1-51f3-458d-aaa4-227ead315b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.872347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797bcd1-51f3-458d-aaa4-227ead315b67 admin admin] PATH_INFO: `/v3/projects/7e95fc3475a94a3d9ab3f9452fc3b4aa/users/cf20058e11614e68ac3b60d744b16843/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.873723 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405e1f9-53f3-474d-8713-4d9d54adfeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:31.874363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405e1f9-53f3-474d-8713-4d9d54adfeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.874827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405e1f9-53f3-474d-8713-4d9d54adfeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.875096 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405e1f9-53f3-474d-8713-4d9d54adfeb7 admin admin] PATH_INFO: `/v3/projects/bef2ca5966c945d7b47b1cccba7399b2/users/5223e9f5157743419bec0870f6917f89/roles/8f49b16402cd497da63ff419948304d5` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.887688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797bcd1-51f3-458d-aaa4-227ead315b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e95fc3475a94a3d9ab3f9452fc3b4aa, user_id=cf20058e11614e68ac3b60d744b16843, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.890621 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797bcd1-51f3-458d-aaa4-227ead315b67 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.891258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405e1f9-53f3-474d-8713-4d9d54adfeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef2ca5966c945d7b47b1cccba7399b2, user_id=5223e9f5157743419bec0870f6917f89, role_id=8f49b16402cd497da63ff419948304d5)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:31.892290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-a405e1f9-53f3-474d-8713-4d9d54adfeb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:24:31.892290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:24:31.892290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:24:31.894991 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405e1f9-53f3-474d-8713-4d9d54adfeb7 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:31.906019 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 761/1554] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Sep 14 15:24:31 2022] PUT /identity/v3/projects/7e95fc3475a94a3d9ab3f9452fc3b4aa/users/cf20058e11614e68ac3b60d744b16843/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:24:31.911156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37619315-a6dd-4fa0-8285-ac5fd8cab374 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.911440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37619315-a6dd-4fa0-8285-ac5fd8cab374 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.911914 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37619315-a6dd-4fa0-8285-ac5fd8cab374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.912781 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 794/1555] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Sep 14 15:24:31 2022] PUT /identity/v3/projects/bef2ca5966c945d7b47b1cccba7399b2/users/5223e9f5157743419bec0870f6917f89/roles/8f49b16402cd497da63ff419948304d5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:24:31.917650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:31.917934 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:31.918204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:31.932342 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-37619315-a6dd-4fa0-8285-ac5fd8cab374 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:31.933581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-37619315-a6dd-4fa0-8285-ac5fd8cab374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:31.937924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] MFA Rules not processed for user `ea41adfa24e148959dc896e18ec4fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:31.939080 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:31.981273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:31.981515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:31.995855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 762/1556] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:24:32.005394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 795/1557] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:24:32.008014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37619315-a6dd-4fa0-8285-ac5fd8cab374 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:32.015449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:32.016897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:32.067439 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37619315-a6dd-4fa0-8285-ac5fd8cab374 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:32.071163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231e6f8-667f-42dc-8843-421396146664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:32.071802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231e6f8-667f-42dc-8843-421396146664 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:32.072104 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231e6f8-667f-42dc-8843-421396146664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:32.072375 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231e6f8-667f-42dc-8843-421396146664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:32.076474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080a06-d3bb-470f-a439-06fbddef0fd6 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:32.080814 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:32.081414 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:32.081692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:32.081990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:32.082475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231e6f8-667f-42dc-8843-421396146664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:32.083928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231e6f8-667f-42dc-8843-421396146664 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:32.094901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 763/1558] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:24:32.095981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:32.097469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:32.108075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 796/1559] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:24:37.279509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041ef5-eaa8-4037-8794-cafb92105ea4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:37.280651 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041ef5-eaa8-4037-8794-cafb92105ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:37.280928 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041ef5-eaa8-4037-8794-cafb92105ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:37.330762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-77041ef5-eaa8-4037-8794-cafb92105ea4 None None] MFA Rules not processed for user `cf20058e11614e68ac3b60d744b16843`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:37.332222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-77041ef5-eaa8-4037-8794-cafb92105ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:37.457455 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 764/1560] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:37.457803 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:37.468495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b0d57-6961-422e-b0b8-e52753e5da5d service neutron] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:37.473919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:37.474777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:37.475212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:37.475631 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] PATH_INFO: `/v3/projects` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:37.476461 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:37.478529 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:37.515508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 797/1561] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Sep 14 15:24:37 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:24:37.519923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041ef5-eaa8-4037-8794-cafb92105ea4 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:37.536635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041ef5-eaa8-4037-8794-cafb92105ea4 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:37.631841 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:37.632477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:37.632757 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:37.633029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:37.633717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:37.636395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:37.679845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 765/1562] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:24:37 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:24:37.681493 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:37.706551 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66bc1-5760-47d2-a75f-b52ccf011aea admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:37.714964 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:37.715952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:37.716304 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:37.716970 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:37.717351 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:37.719274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:37.741449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 798/1563] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:37.745752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:37.762204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e5a3a-ea2b-464d-98ae-1f2fd2d244cb admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:37.767956 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:37.769293 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:37.769578 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:37.769855 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] PATH_INFO: `/v3/projects/00b7fe4aa67040dd8267d750c94f459a/users/07bcbda6b9a54f9d9961c7d9d7dc34b1/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:37.795592 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b7fe4aa67040dd8267d750c94f459a, user_id=07bcbda6b9a54f9d9961c7d9d7dc34b1, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:37.801806 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:37.825570 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:37.846828 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 766/1564] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Sep 14 15:24:37 2022] PUT /identity/v3/projects/00b7fe4aa67040dd8267d750c94f459a/users/07bcbda6b9a54f9d9961c7d9d7dc34b1/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:24:37.850921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:37.871786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0312-93fa-4bea-994c-83df481be8aa admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:37.969087 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247c594-391c-410e-916e-1692df92ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:37.969712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c594-391c-410e-916e-1692df92ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:37.969983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c594-391c-410e-916e-1692df92ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:37.970417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c594-391c-410e-916e-1692df92ecb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:37.971072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247c594-391c-410e-916e-1692df92ecb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:37.973503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247c594-391c-410e-916e-1692df92ecb2 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:37.985052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 799/1565] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:37.989643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:38.009312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e6e7-a96a-445c-a4c8-fb08107b13bc admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:38.014831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:38.015910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.016385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.016845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] PATH_INFO: `/v3/projects/00b7fe4aa67040dd8267d750c94f459a/users/07bcbda6b9a54f9d9961c7d9d7dc34b1/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.019312 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b7fe4aa67040dd8267d750c94f459a, user_id=07bcbda6b9a54f9d9961c7d9d7dc34b1, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:38.025046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:38.045222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 767/1566] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Sep 14 15:24:37 2022] PUT /identity/v3/projects/00b7fe4aa67040dd8267d750c94f459a/users/07bcbda6b9a54f9d9961c7d9d7dc34b1/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:24:38.247946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f2d9b-6d5e-4d13-b8bb-809fb6205b00 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.248281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f2d9b-6d5e-4d13-b8bb-809fb6205b00 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.248526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f2d9b-6d5e-4d13-b8bb-809fb6205b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.286324 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-1b0f2d9b-6d5e-4d13-b8bb-809fb6205b00 None None] MFA Rules not processed for user `5223e9f5157743419bec0870f6917f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:38.287921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-1b0f2d9b-6d5e-4d13-b8bb-809fb6205b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:38.346790 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:38.379688 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 800/1567] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:38.380901 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:38.482690 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a89a8-caed-4502-8da1-5483b9b9abe3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:38.488318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:38.489202 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.489487 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.489756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.490395 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:38.492372 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:38.523636 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 768/1568] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Sep 14 15:24:38 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:24:38.529916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f2d9b-6d5e-4d13-b8bb-809fb6205b00 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:38.556014 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f2d9b-6d5e-4d13-b8bb-809fb6205b00 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:38.646563 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:38.647569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.647985 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.648468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] PATH_INFO: `/v3/users` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.649328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:38.651391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:38.680772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 801/1569] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Sep 14 15:24:38 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:24:38.684565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:38.700540 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba031f8-ddc4-4d6c-9c6a-8d0fb69120cf admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:38.711930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:38.713105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.713393 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.713716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.714611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:38.716567 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:38.732154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 769/1570] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:38.733240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:38.753775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645a716-72d9-4922-88e9-7da6a7c57926 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:38.761740 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:38.762965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.762965 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.763738 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] PATH_INFO: `/v3/projects/b6caf3ac0e254753994043e7e3a8227d/users/4d6477cf16114cfba2eab4b13b67deda/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.787967 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6caf3ac0e254753994043e7e3a8227d, user_id=4d6477cf16114cfba2eab4b13b67deda, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:38.791519 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:38.834998 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 802/1571] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Sep 14 15:24:38 2022] PUT /identity/v3/projects/b6caf3ac0e254753994043e7e3a8227d/users/4d6477cf16114cfba2eab4b13b67deda/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:24:38.838940 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:38.865387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc3aa-77f5-457f-bfa8-c3256c657d00 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:38.964282 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfc9fc-9e9b-4cfe-8e21-d95d12b12a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:38.965066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc9fc-9e9b-4cfe-8e21-d95d12b12a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.965435 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc9fc-9e9b-4cfe-8e21-d95d12b12a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.965811 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc9fc-9e9b-4cfe-8e21-d95d12b12a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.966868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc9fc-9e9b-4cfe-8e21-d95d12b12a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:38.969494 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc9fc-9e9b-4cfe-8e21-d95d12b12a9d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:38.991981 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 770/1572] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Sep 14 15:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:24:38.995909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:39.012565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c830c-135e-44b3-9cf0-77ae8d514f9e admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:39.025184 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:39.025984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:39.026366 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:39.026741 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] PATH_INFO: `/v3/projects/b6caf3ac0e254753994043e7e3a8227d/users/4d6477cf16114cfba2eab4b13b67deda/roles/a21b0e5a21b74ed488e8178b7c0b2696` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:39.035034 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6caf3ac0e254753994043e7e3a8227d, user_id=4d6477cf16114cfba2eab4b13b67deda, role_id=a21b0e5a21b74ed488e8178b7c0b2696)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:39.037887 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:39.063475 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 803/1573] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Sep 14 15:24:38 2022] PUT /identity/v3/projects/b6caf3ac0e254753994043e7e3a8227d/users/4d6477cf16114cfba2eab4b13b67deda/roles/a21b0e5a21b74ed488e8178b7c0b2696 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:24:44.334625 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092847f-e43c-4eea-9fc2-17e351fa5fba None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:44.335403 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092847f-e43c-4eea-9fc2-17e351fa5fba None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:44.336310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092847f-e43c-4eea-9fc2-17e351fa5fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:44.382400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e092847f-e43c-4eea-9fc2-17e351fa5fba None None] MFA Rules not processed for user `07bcbda6b9a54f9d9961c7d9d7dc34b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:44.383902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e092847f-e43c-4eea-9fc2-17e351fa5fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:44.434659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:44.480012 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 771/1574] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:44.490826 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:44.493851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:44.620827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e0e65-ff91-429c-9d75-ba5cc6f23d81 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:44.628009 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f94895-8d64-4565-ac28-305402e2128f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344958332b5549558b26d199e53b8b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:44.630280 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f94895-8d64-4565-ac28-305402e2128f service glance] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:44.630736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f94895-8d64-4565-ac28-305402e2128f service glance] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:44.631163 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f94895-8d64-4565-ac28-305402e2128f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:44.683360 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:44.724420 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f94895-8d64-4565-ac28-305402e2128f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:44.726330 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f94895-8d64-4565-ac28-305402e2128f service glance] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:44.748222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 804/1575] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:45.147160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:45.147748 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:45.148226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:45.228237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:45.229491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:45.387663 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 772/1576] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:24:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:45.554222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ce95-d2fb-4fd3-b4a6-9fd063cc7503 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:45.554666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ce95-d2fb-4fd3-b4a6-9fd063cc7503 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:45.554769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ce95-d2fb-4fd3-b4a6-9fd063cc7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:45.580050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:45.581491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:45.598049 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-32f7ce95-d2fb-4fd3-b4a6-9fd063cc7503 None None] MFA Rules not processed for user `4d6477cf16114cfba2eab4b13b67deda`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:45.602228 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-32f7ce95-d2fb-4fd3-b4a6-9fd063cc7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:45.716462 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988ac5d-7419-43a6-8c4f-82ebe9aeaed0 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:45.717226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 805/1577] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:24:45.723334 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7ce95-d2fb-4fd3-b4a6-9fd063cc7503 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:45.725365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15f736-8309-4187-adbd-33ec79e85a12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:45.726162 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f736-8309-4187-adbd-33ec79e85a12 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:45.726446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f736-8309-4187-adbd-33ec79e85a12 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:45.726743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f736-8309-4187-adbd-33ec79e85a12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:45.735666 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7ce95-d2fb-4fd3-b4a6-9fd063cc7503 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:45.737386 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15f736-8309-4187-adbd-33ec79e85a12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:45.739523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15f736-8309-4187-adbd-33ec79e85a12 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:45.740266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344958332b5549558b26d199e53b8b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:45.740992 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:45.741367 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:45.741735 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:45.753446 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 773/1578] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:24:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 15:24:45.850397 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:45.852197 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:45.872250 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 806/1579] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:47.715113 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f57e-65c2-426e-96d4-a8520c84f45d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:47.715601 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f57e-65c2-426e-96d4-a8520c84f45d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:47.715673 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f57e-65c2-426e-96d4-a8520c84f45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:47.748508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-07d4f57e-65c2-426e-96d4-a8520c84f45d None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:47.752801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-07d4f57e-65c2-426e-96d4-a8520c84f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:47.768624 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 774/1580] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:24:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:47.793160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:47.810170 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8494ff-0683-4f6c-a819-5a3c76e31edb service glance] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:47.823108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0e3a-b4fe-496f-afae-d141f6a84334 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:47.823973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e3a-b4fe-496f-afae-d141f6a84334 service swift] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:47.824262 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e3a-b4fe-496f-afae-d141f6a84334 service swift] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:47.824603 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e3a-b4fe-496f-afae-d141f6a84334 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:47.902902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0e3a-b4fe-496f-afae-d141f6a84334 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:47.904370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0e3a-b4fe-496f-afae-d141f6a84334 service swift] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:47.960370 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 807/1581] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:24:56.829206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd8e7-cc37-42fa-8e36-1afa9b663049 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:56.830097 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd8e7-cc37-42fa-8e36-1afa9b663049 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:56.830442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd8e7-cc37-42fa-8e36-1afa9b663049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:56.850445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-12abd8e7-cc37-42fa-8e36-1afa9b663049 None None] MFA Rules not processed for user `cf20058e11614e68ac3b60d744b16843`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:56.851917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-12abd8e7-cc37-42fa-8e36-1afa9b663049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:56.859445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 775/1582] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:24:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:57.167477 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56b345-74eb-4739-93fc-58ba209584bf None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.168085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56b345-74eb-4739-93fc-58ba209584bf None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.168180 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56b345-74eb-4739-93fc-58ba209584bf None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.171249 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 808/1583] 10.222.0.65 () {54 vars in 962 bytes} [Wed Sep 14 15:24:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:57.179574 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413bdd-b4ca-46f8-9a44-06141640df89 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.179907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413bdd-b4ca-46f8-9a44-06141640df89 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.180185 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413bdd-b4ca-46f8-9a44-06141640df89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.189436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:57.229201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-61413bdd-b4ca-46f8-9a44-06141640df89 None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:57.230588 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-61413bdd-b4ca-46f8-9a44-06141640df89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:57.306286 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 776/1584] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Sep 14 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:57.311764 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93ebc-f168-4f88-8607-b64665333e56 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.312149 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93ebc-f168-4f88-8607-b64665333e56 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.312549 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93ebc-f168-4f88-8607-b64665333e56 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.314857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 809/1585] 10.222.0.65 () {54 vars in 912 bytes} [Wed Sep 14 15:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:57.321599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2e36-2cc5-4e12-ad44-0d01e8f133e2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.321902 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2e36-2cc5-4e12-ad44-0d01e8f133e2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.322204 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2e36-2cc5-4e12-ad44-0d01e8f133e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.342863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-efdd2e36-2cc5-4e12-ad44-0d01e8f133e2 None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:57.344343 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-efdd2e36-2cc5-4e12-ad44-0d01e8f133e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:57.353776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 777/1586] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:57.366368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93ebc-f168-4f88-8607-b64665333e56 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:57.368520 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-7db93ebc-f168-4f88-8607-b64665333e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:57.384046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93ebc-f168-4f88-8607-b64665333e56 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:57.387726 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55d952-d846-4683-a9d8-1095a1d7f7a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344958332b5549558b26d199e53b8b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:57.388357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55d952-d846-4683-a9d8-1095a1d7f7a1 service glance] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.388628 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55d952-d846-4683-a9d8-1095a1d7f7a1 service glance] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.388894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55d952-d846-4683-a9d8-1095a1d7f7a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.400496 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55d952-d846-4683-a9d8-1095a1d7f7a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:57.401845 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55d952-d846-4683-a9d8-1095a1d7f7a1 service glance] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:57.414742 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 810/1587] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:57.816712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf332f-658c-42a2-b8ad-959172a454eb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.817021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf332f-658c-42a2-b8ad-959172a454eb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.817302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf332f-658c-42a2-b8ad-959172a454eb None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.818832 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 778/1588] 10.222.0.65 () {54 vars in 912 bytes} [Wed Sep 14 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:57.824785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84541d-72ed-4db9-9ce5-3223ec193ebd None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.825072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84541d-72ed-4db9-9ce5-3223ec193ebd None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.825376 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84541d-72ed-4db9-9ce5-3223ec193ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.864497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-5f84541d-72ed-4db9-9ce5-3223ec193ebd None None] MFA Rules not processed for user `317574f1c46a45d9b600329f73a993f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:57.865732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-5f84541d-72ed-4db9-9ce5-3223ec193ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:57.874188 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:57.925582 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 811/1589] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:57.938182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf332f-658c-42a2-b8ad-959172a454eb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:57.949429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf332f-658c-42a2-b8ad-959172a454eb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:57.956416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634da00-ef2b-47e9-868b-ee0046e9a8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:57.957130 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634da00-ef2b-47e9-868b-ee0046e9a8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:57.957478 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634da00-ef2b-47e9-868b-ee0046e9a8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:57.958037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634da00-ef2b-47e9-868b-ee0046e9a8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:57.966695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634da00-ef2b-47e9-868b-ee0046e9a8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:57.968267 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634da00-ef2b-47e9-868b-ee0046e9a8c0 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:57.978088 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 779/1590] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:24:58.386849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e887b-856b-4504-9dc9-04d6fe10890f None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:58.387281 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e887b-856b-4504-9dc9-04d6fe10890f None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:58.387459 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e887b-856b-4504-9dc9-04d6fe10890f None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:58.390010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 812/1591] 10.222.0.65 () {54 vars in 962 bytes} [Wed Sep 14 15:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:58.398623 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67814d-164f-493d-a705-41c0f3e7398d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:58.398909 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67814d-164f-493d-a705-41c0f3e7398d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:58.399274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67814d-164f-493d-a705-41c0f3e7398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:58.400733 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e887b-856b-4504-9dc9-04d6fe10890f None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:58.421495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0a67814d-164f-493d-a705-41c0f3e7398d None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:58.422722 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0a67814d-164f-493d-a705-41c0f3e7398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:58.432489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 780/1592] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Sep 14 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:58.438954 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f42e18-abb4-43bc-bcc5-c013829f7111 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:58.439285 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f42e18-abb4-43bc-bcc5-c013829f7111 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:58.439553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f42e18-abb4-43bc-bcc5-c013829f7111 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:58.441021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 781/1593] 10.222.0.65 () {54 vars in 912 bytes} [Wed Sep 14 15:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:24:58.445978 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330221-f37f-46f1-9c8a-51c6d4ebd276 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:58.446258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330221-f37f-46f1-9c8a-51c6d4ebd276 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:58.446530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330221-f37f-46f1-9c8a-51c6d4ebd276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:58.465963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b4330221-f37f-46f1-9c8a-51c6d4ebd276 None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:58.467550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b4330221-f37f-46f1-9c8a-51c6d4ebd276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:58.477411 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 782/1594] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:58.483716 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e887b-856b-4504-9dc9-04d6fe10890f None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:58.488681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4330221-f37f-46f1-9c8a-51c6d4ebd276 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:58.489182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856613-c61c-44c4-8d51-94c6f77b3885 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05057b8842ea4cf88ba987b913308cd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:58.489798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856613-c61c-44c4-8d51-94c6f77b3885 service placement] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:58.490252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856613-c61c-44c4-8d51-94c6f77b3885 service placement] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:58.490524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856613-c61c-44c4-8d51-94c6f77b3885 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:58.492495 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9a856613-c61c-44c4-8d51-94c6f77b3885 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:58.498221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4330221-f37f-46f1-9c8a-51c6d4ebd276 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:58.502591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:58.503207 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:58.503485 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:58.503752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:58.508863 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a856613-c61c-44c4-8d51-94c6f77b3885 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:58.510815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a856613-c61c-44c4-8d51-94c6f77b3885 service placement] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:58.517989 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:58.519503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:58.522024 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 813/1595] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:58.530858 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 783/1596] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:25:00.475942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ec18-233f-4990-b357-9ce855874e96 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:00.476419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ec18-233f-4990-b357-9ce855874e96 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:00.476608 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ec18-233f-4990-b357-9ce855874e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:00.497681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-1475ec18-233f-4990-b357-9ce855874e96 None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:25:00.499010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-1475ec18-233f-4990-b357-9ce855874e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:25:00.507642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 814/1597] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:25:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:25:00.520468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:25:00.531569 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b818da9-a402-48f0-b10c-ecde3feb93c9 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:25:00.536775 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:25:00.537365 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:00.537645 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:00.537917 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:00.546079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:25:00.547655 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:25:00.555921 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 784/1598] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:25:08.571789 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b21e-5298-41f3-89bb-73402971ed33 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:08.572359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b21e-5298-41f3-89bb-73402971ed33 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:08.572359 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b21e-5298-41f3-89bb-73402971ed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:08.592445 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-fb10b21e-5298-41f3-89bb-73402971ed33 None None] MFA Rules not processed for user `317574f1c46a45d9b600329f73a993f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:25:08.593648 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-fb10b21e-5298-41f3-89bb-73402971ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:25:08.602035 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 815/1599] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Sep 14 15:25:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:25:08.616363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:25:08.629109 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74db2b-312f-4a45-a3ec-afc09bf7c621 service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:25:08.632732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8156a-2641-4ef8-bcaf-df78ebae874d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:25:08.633329 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8156a-2641-4ef8-bcaf-df78ebae874d service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:08.633607 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8156a-2641-4ef8-bcaf-df78ebae874d service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:08.633896 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8156a-2641-4ef8-bcaf-df78ebae874d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:08.641504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8156a-2641-4ef8-bcaf-df78ebae874d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:25:08.642919 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8156a-2641-4ef8-bcaf-df78ebae874d service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:25:08.651190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 785/1600] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:25:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:25:09.571502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12dee-ea95-4c3f-b0bd-e9d5f15eaa56 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:09.572116 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12dee-ea95-4c3f-b0bd-e9d5f15eaa56 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:09.573246 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12dee-ea95-4c3f-b0bd-e9d5f15eaa56 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:09.575399 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 816/1601] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:25:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:25:09.666032 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f213de8-8f80-4171-9a92-c9649fd6c68b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:09.666923 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f213de8-8f80-4171-9a92-c9649fd6c68b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:09.667468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f213de8-8f80-4171-9a92-c9649fd6c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:09.688098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6f213de8-8f80-4171-9a92-c9649fd6c68b None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:25:09.689708 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6f213de8-8f80-4171-9a92-c9649fd6c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:25:09.701187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 786/1602] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:25:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:25:09.746468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e12dee-ea95-4c3f-b0bd-e9d5f15eaa56 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:25:09.762821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e12dee-ea95-4c3f-b0bd-e9d5f15eaa56 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:25:09.768853 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d774-e213-4757-a371-9d87cfdbc01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:25:09.769644 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d774-e213-4757-a371-9d87cfdbc01c service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:09.770017 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d774-e213-4757-a371-9d87cfdbc01c service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:09.770389 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d774-e213-4757-a371-9d87cfdbc01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:09.792577 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3d774-e213-4757-a371-9d87cfdbc01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:25:09.794269 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3d774-e213-4757-a371-9d87cfdbc01c service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:25:09.806437 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 817/1603] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:25:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:25:15.804983 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04368c-e4cd-41a8-a1e4-b96818a13b44 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:15.805617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04368c-e4cd-41a8-a1e4-b96818a13b44 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:15.805617 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04368c-e4cd-41a8-a1e4-b96818a13b44 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:15.806849 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 787/1604] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:25:15.813827 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54364c-f3f0-419c-8712-9792410f838b None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:15.814680 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54364c-f3f0-419c-8712-9792410f838b None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:15.814953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54364c-f3f0-419c-8712-9792410f838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:15.835352 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-8a54364c-f3f0-419c-8712-9792410f838b None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:25:15.836619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8a54364c-f3f0-419c-8712-9792410f838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:25:15.845942 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 818/1605] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:25:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:25:15.863480 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04368c-e4cd-41a8-a1e4-b96818a13b44 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:25:15.879870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04368c-e4cd-41a8-a1e4-b96818a13b44 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:25:15.885897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86ad16-3f23-4dc5-b337-70e85dfd73f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:25:15.886508 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86ad16-3f23-4dc5-b337-70e85dfd73f5 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:15.886792 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86ad16-3f23-4dc5-b337-70e85dfd73f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:15.887067 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86ad16-3f23-4dc5-b337-70e85dfd73f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:15.897349 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86ad16-3f23-4dc5-b337-70e85dfd73f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:25:15.898962 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86ad16-3f23-4dc5-b337-70e85dfd73f5 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:25:15.911388 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 788/1606] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:25:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:25:25.829809 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=64 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:25:25.905883 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=77 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:25:35.089083 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54364c-f3f0-419c-8712-9792410f838b None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:25:35.098904 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54364c-f3f0-419c-8712-9792410f838b None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:25:35.102538 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd33a24-27bc-4663-b675-c174bc357142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:25:35.103137 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd33a24-27bc-4663-b675-c174bc357142 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:35.103409 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd33a24-27bc-4663-b675-c174bc357142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:35.103675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd33a24-27bc-4663-b675-c174bc357142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:35.113834 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd33a24-27bc-4663-b675-c174bc357142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:25:35.115297 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd33a24-27bc-4663-b675-c174bc357142 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:25:35.125172 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 819/1607] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:25:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:25:39.012454 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9ba21-e10e-4746-a237-1ec11bcdaebb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:39.013001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9ba21-e10e-4746-a237-1ec11bcdaebb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:39.013001 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9ba21-e10e-4746-a237-1ec11bcdaebb None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:39.014302 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 789/1608] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:25:39.034326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b042-9b4d-46be-9619-066690f0cc96 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:39.034326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b042-9b4d-46be-9619-066690f0cc96 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:39.034326 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b042-9b4d-46be-9619-066690f0cc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:39.057150 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-4895b042-9b4d-46be-9619-066690f0cc96 None None] MFA Rules not processed for user `76b507a36c834754bd4ac76935e64b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:25:39.058418 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-4895b042-9b4d-46be-9619-066690f0cc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:25:39.069151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 820/1609] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:25:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:25:39.083079 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9ba21-e10e-4746-a237-1ec11bcdaebb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:25:39.098037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9ba21-e10e-4746-a237-1ec11bcdaebb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:25:39.104063 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd53974-4dbd-437f-a1e3-db1438901409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:25:39.104670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53974-4dbd-437f-a1e3-db1438901409 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:39.105385 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53974-4dbd-437f-a1e3-db1438901409 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:39.105670 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53974-4dbd-437f-a1e3-db1438901409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:39.115541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd53974-4dbd-437f-a1e3-db1438901409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:25:39.117630 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd53974-4dbd-437f-a1e3-db1438901409 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:25:39.130476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 790/1610] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:25:40.528421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e458-9553-44d3-82e8-96bb85252ec2 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:40.528968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e458-9553-44d3-82e8-96bb85252ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:40.528968 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e458-9553-44d3-82e8-96bb85252ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:40.548571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-fcc4e458-9553-44d3-82e8-96bb85252ec2 None None] MFA Rules not processed for user `5223e9f5157743419bec0870f6917f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:25:40.550429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-fcc4e458-9553-44d3-82e8-96bb85252ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:25:40.558226 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 821/1611] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:25:40.888815 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dc826-d356-4ffe-b8d8-8a40d9afbeac None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:40.889339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dc826-d356-4ffe-b8d8-8a40d9afbeac None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:40.889429 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dc826-d356-4ffe-b8d8-8a40d9afbeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:40.910099 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f56dc826-d356-4ffe-b8d8-8a40d9afbeac None None] MFA Rules not processed for user `317574f1c46a45d9b600329f73a993f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:25:40.911317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f56dc826-d356-4ffe-b8d8-8a40d9afbeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:25:40.918235 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 791/1612] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:25:40.930579 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4e458-9553-44d3-82e8-96bb85252ec2 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:25:40.940024 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4e458-9553-44d3-82e8-96bb85252ec2 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:25:40.944119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93c19c-92ec-4929-9978-91554a15c714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:25:40.944714 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93c19c-92ec-4929-9978-91554a15c714 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:25:40.944990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93c19c-92ec-4929-9978-91554a15c714 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:25:40.945259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93c19c-92ec-4929-9978-91554a15c714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:25:40.952224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93c19c-92ec-4929-9978-91554a15c714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:25:40.953629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93c19c-92ec-4929-9978-91554a15c714 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:25:40.961993 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 822/1613] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:25:50.904179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=9 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:25:50.958546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=18 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:21.722905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cdb0b-90ce-431b-99e2-29ab604c6600 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:21.723469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cdb0b-90ce-431b-99e2-29ab604c6600 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:21.723469 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cdb0b-90ce-431b-99e2-29ab604c6600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:21.742585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ff2cdb0b-90ce-431b-99e2-29ab604c6600 None None] MFA Rules not processed for user `5223e9f5157743419bec0870f6917f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:21.743793 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ff2cdb0b-90ce-431b-99e2-29ab604c6600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:21.751371 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 792/1614] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:31.486476 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddd5a-cf09-4b78-b604-47b63944fbbf None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.487018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddd5a-cf09-4b78-b604-47b63944fbbf None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.487102 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddd5a-cf09-4b78-b604-47b63944fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.507119 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-d5cddd5a-cf09-4b78-b604-47b63944fbbf None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:31.508357 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-d5cddd5a-cf09-4b78-b604-47b63944fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:31.515564 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 823/1615] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:31.557069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cdb0b-90ce-431b-99e2-29ab604c6600 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:31.569224 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cdb0b-90ce-431b-99e2-29ab604c6600 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:31.574218 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12ec98-e7e6-4c71-9d7e-f83c6095a066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:31.574817 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12ec98-e7e6-4c71-9d7e-f83c6095a066 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.575126 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12ec98-e7e6-4c71-9d7e-f83c6095a066 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.575394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12ec98-e7e6-4c71-9d7e-f83c6095a066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.583212 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12ec98-e7e6-4c71-9d7e-f83c6095a066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:31.584836 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12ec98-e7e6-4c71-9d7e-f83c6095a066 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:31.592724 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 793/1616] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:26:34.927243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76b6c9-676c-4a09-82c5-de08d0907a77 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:34.927772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76b6c9-676c-4a09-82c5-de08d0907a77 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:34.927772 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76b6c9-676c-4a09-82c5-de08d0907a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:34.947692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-9f76b6c9-676c-4a09-82c5-de08d0907a77 None None] MFA Rules not processed for user `5223e9f5157743419bec0870f6917f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:34.948930 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-9f76b6c9-676c-4a09-82c5-de08d0907a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:34.955876 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 824/1617] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:41.589489 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=9 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:44.941449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=6 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:02.294161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da780b-4283-4dc3-96b1-38ed519552a4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:02.294678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da780b-4283-4dc3-96b1-38ed519552a4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:02.294782 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da780b-4283-4dc3-96b1-38ed519552a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:02.314416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c1da780b-4283-4dc3-96b1-38ed519552a4 None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:27:02.315634 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c1da780b-4283-4dc3-96b1-38ed519552a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:27:02.322952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 794/1618] 10.222.0.65 () {58 vars in 967 bytes} [Wed Sep 14 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:27:02.335408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76b6c9-676c-4a09-82c5-de08d0907a77 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:27:02.346987 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76b6c9-676c-4a09-82c5-de08d0907a77 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:27:02.351963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:27:02.352499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:02.352773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:02.353041 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:02.362467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:27:02.372897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:27:02.382195 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 825/1619] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:27:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:27:12.309305 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:12.375243 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=6 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:18.989210 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8152-f203-4743-a381-1d5f6b3ea8c1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:18.989777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8152-f203-4743-a381-1d5f6b3ea8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:18.989777 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8152-f203-4743-a381-1d5f6b3ea8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:19.009290 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7a6a8152-f203-4743-a381-1d5f6b3ea8c1 None None] MFA Rules not processed for user `5223e9f5157743419bec0870f6917f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:27:19.010539 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7a6a8152-f203-4743-a381-1d5f6b3ea8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:27:19.018026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 795/1620] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:27:29.003629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:34.098229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:27:34.107206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2fac5-2a76-4c6a-b6a4-6e1abe53021d service swift] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:27:34.111038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37975ac5-44c3-4e29-9ea9-3d4ad0487332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:27:34.111662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37975ac5-44c3-4e29-9ea9-3d4ad0487332 service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:34.111976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37975ac5-44c3-4e29-9ea9-3d4ad0487332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:34.112251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37975ac5-44c3-4e29-9ea9-3d4ad0487332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:34.121377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37975ac5-44c3-4e29-9ea9-3d4ad0487332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:27:34.122732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37975ac5-44c3-4e29-9ea9-3d4ad0487332 service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:27:34.132885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 826/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:27:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:27:44.128629 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=6 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:28:48.761769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd061-bcbc-48b8-b722-ae7e153f0752 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:48.762266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd061-bcbc-48b8-b722-ae7e153f0752 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:48.762362 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd061-bcbc-48b8-b722-ae7e153f0752 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:48.763707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 796/1622] 10.222.0.65 () {54 vars in 961 bytes} [Wed Sep 14 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:28:48.769639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059a992-c85f-4fd7-9092-5853c57e0c24 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:48.770100 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059a992-c85f-4fd7-9092-5853c57e0c24 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:48.770200 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059a992-c85f-4fd7-9092-5853c57e0c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:48.792353 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-8059a992-c85f-4fd7-9092-5853c57e0c24 None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:28:48.793510 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8059a992-c85f-4fd7-9092-5853c57e0c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:28:48.802586 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 827/1623] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Sep 14 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:28:48.810308 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dd061-bcbc-48b8-b722-ae7e153f0752 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:28:48.823773 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dd061-bcbc-48b8-b722-ae7e153f0752 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:28:48.830381 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05057b8842ea4cf88ba987b913308cd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:28:48.831159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:48.831442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:48.831715 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:48.840239 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:28:48.841844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:28:48.852762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 797/1624] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:28:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:28:49.905798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ced69d-7185-425c-a04f-a0697b5e35b6 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:49.906319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ced69d-7185-425c-a04f-a0697b5e35b6 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:49.906319 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ced69d-7185-425c-a04f-a0697b5e35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:49.927695 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-17ced69d-7185-425c-a04f-a0697b5e35b6 None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:28:49.929027 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-17ced69d-7185-425c-a04f-a0697b5e35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:28:49.936194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 828/1625] 10.222.0.65 () {58 vars in 967 bytes} [Wed Sep 14 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:28:49.984179 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:28:49.995274 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459baae-5f12-4b62-ac2e-1622fd2dff27 service placement] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:28:50.001156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:28:50.001756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:50.002038 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:50.002310 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:50.010633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:28:50.012256 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:28:50.021078 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 798/1626] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:28:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:28:50.504298 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4d5b-59f8-4a15-99d2-984b0d89cf88 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:50.504583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4d5b-59f8-4a15-99d2-984b0d89cf88 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:50.504866 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4d5b-59f8-4a15-99d2-984b0d89cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:50.524260 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-b5de4d5b-59f8-4a15-99d2-984b0d89cf88 None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:28:50.525460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-b5de4d5b-59f8-4a15-99d2-984b0d89cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:28:50.535562 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 829/1627] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:28:50.547566 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:28:50.558237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5407-3644-4be8-bff5-3bc23fdbf277 service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:28:50.563685 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207631e-3be7-44b6-bef2-5d49ee203a84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:28:50.564417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207631e-3be7-44b6-bef2-5d49ee203a84 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:50.564699 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207631e-3be7-44b6-bef2-5d49ee203a84 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:50.564963 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207631e-3be7-44b6-bef2-5d49ee203a84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:50.573693 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207631e-3be7-44b6-bef2-5d49ee203a84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:28:50.575259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207631e-3be7-44b6-bef2-5d49ee203a84 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:28:50.585361 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 799/1628] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:28:59.114497 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdac692-0442-4e05-bd59-5371ef2eb03c None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:59.115022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdac692-0442-4e05-bd59-5371ef2eb03c None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:59.115022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdac692-0442-4e05-bd59-5371ef2eb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:59.134402 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-0cdac692-0442-4e05-bd59-5371ef2eb03c None None] MFA Rules not processed for user `cf20058e11614e68ac3b60d744b16843`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:28:59.135585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-0cdac692-0442-4e05-bd59-5371ef2eb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:28:59.143440 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 830/1629] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:29:00.581821 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=18 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:29:03.099154 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd23f3-2485-47d2-8597-9e06e519cb58 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:29:03.099744 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd23f3-2485-47d2-8597-9e06e519cb58 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:29:03.099975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd23f3-2485-47d2-8597-9e06e519cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:29:03.119916 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2cbd23f3-2485-47d2-8597-9e06e519cb58 None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:29:03.121139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2cbd23f3-2485-47d2-8597-9e06e519cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:29:03.129026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 800/1630] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Sep 14 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:29:03.141704 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdac692-0442-4e05-bd59-5371ef2eb03c None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:29:03.153591 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdac692-0442-4e05-bd59-5371ef2eb03c None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:29:03.159664 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:29:03.160225 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:29:03.160499 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:29:03.160769 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:29:03.169646 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:29:03.171236 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:29:03.179727 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 831/1631] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:29:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:29:13.114786 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:29:13.176801 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=18 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:29:38.263192 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1489d9-ddfc-4aa7-a4ef-444a92986c1d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:29:38.263668 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1489d9-ddfc-4aa7-a4ef-444a92986c1d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:29:38.263760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1489d9-ddfc-4aa7-a4ef-444a92986c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:29:38.284237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ab1489d9-ddfc-4aa7-a4ef-444a92986c1d None None] MFA Rules not processed for user `5223e9f5157743419bec0870f6917f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:29:38.285982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ab1489d9-ddfc-4aa7-a4ef-444a92986c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:29:38.293037 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 801/1632] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:29:46.069010 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:29:46.080785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabb034-499a-4b14-b124-4dec9a133d9e service swift] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:29:46.087050 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:29:46.087661 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:29:46.087976 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:29:46.088251 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:29:46.097070 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:29:46.098678 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:29:46.107745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 832/1633] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:29:48.277694 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:29:56.094585 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1489d9-ddfc-4aa7-a4ef-444a92986c1d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:29:56.103560 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=6 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:29:56.111382 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1489d9-ddfc-4aa7-a4ef-444a92986c1d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:29:56.117999 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:29:56.118711 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:29:56.118980 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:29:56.119254 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:29:56.128337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:29:56.129935 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:29:56.139233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 802/1634] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:29:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:29:58.793890 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:29:58.803523 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8af20a-9f47-4ce4-a651-a3c49fef50fc service nova] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:29:58.807201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:29:58.807831 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:29:58.808098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:29:58.808377 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:29:58.818553 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:29:58.820066 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:29:58.831776 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 833/1635] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:29:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:30:00.031018 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:00.040457 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864fab-b62a-4fb0-9f8d-1de27fdb05c0 service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:00.044046 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:00.044649 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:00.044915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:00.045186 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:00.055798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:00.057233 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:00.068506 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 803/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:30:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:30:08.826094 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=6 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:30:10.063838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=12 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:30:47.334201 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:47.345990 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f6b0-8cc3-45b7-a869-7614ca2d871d service neutron] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:47.352194 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:47.352796 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:47.353069 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:47.353337 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:47.363265 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:47.364894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:47.378391 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 834/1637] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:30:47.487300 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:47.498292 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0c39-f451-415e-a26d-c65d51c9034d service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:47.502795 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea387b19-fd2a-47d1-bcc7-526412d0d2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:47.503618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387b19-fd2a-47d1-bcc7-526412d0d2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:47.504108 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387b19-fd2a-47d1-bcc7-526412d0d2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:47.504583 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387b19-fd2a-47d1-bcc7-526412d0d2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:47.512838 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387b19-fd2a-47d1-bcc7-526412d0d2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:47.514576 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387b19-fd2a-47d1-bcc7-526412d0d2a4 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:47.523703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 804/1638] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:30:53.688973 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:53.701229 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce00a25-da26-473c-845d-568c5995cc87 service nova] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:53.708206 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:53.708819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:53.709139 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:53.709368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:53.720784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:53.722284 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:53.733530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 835/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:30:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:30:54.877345 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12204a50-aa76-4bf1-b2ea-4a0d8938cad9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:54.877829 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12204a50-aa76-4bf1-b2ea-4a0d8938cad9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:54.877975 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12204a50-aa76-4bf1-b2ea-4a0d8938cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:54.898103 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-12204a50-aa76-4bf1-b2ea-4a0d8938cad9 None None] MFA Rules not processed for user `09dd7aa113ee4a83b06726b37b522eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:30:54.899320 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-12204a50-aa76-4bf1-b2ea-4a0d8938cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:30:54.906501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 805/1640] 10.222.0.65 () {58 vars in 967 bytes} [Wed Sep 14 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:30:54.946938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:54.958619 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b5490-1e5c-43ba-be34-ce4e69b23ce4 service nova] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:54.963684 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1eeac-9dd4-4861-b25d-17fde2605ab1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8c0a83f53476abaac005263ac3bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:54.964303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1eeac-9dd4-4861-b25d-17fde2605ab1 service swift] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:54.964581 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1eeac-9dd4-4861-b25d-17fde2605ab1 service swift] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:54.964852 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1eeac-9dd4-4861-b25d-17fde2605ab1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:54.973344 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1eeac-9dd4-4861-b25d-17fde2605ab1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:54.974905 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1eeac-9dd4-4861-b25d-17fde2605ab1 service swift] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:54.983016 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 836/1641] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Sep 14 15:30:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:30:55.342700 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12204a50-aa76-4bf1-b2ea-4a0d8938cad9 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:55.352051 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12204a50-aa76-4bf1-b2ea-4a0d8938cad9 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:55.355683 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638112a7-0ad1-46ea-904c-23131d17347a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:55.356283 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638112a7-0ad1-46ea-904c-23131d17347a service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:55.356565 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638112a7-0ad1-46ea-904c-23131d17347a service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:55.356868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638112a7-0ad1-46ea-904c-23131d17347a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:55.420127 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638112a7-0ad1-46ea-904c-23131d17347a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:55.421561 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638112a7-0ad1-46ea-904c-23131d17347a service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:55.431098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 806/1642] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:30:58.709732 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec786-ac68-4d79-a283-71b4b8256552 None None] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:58.710252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec786-ac68-4d79-a283-71b4b8256552 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:58.710347 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec786-ac68-4d79-a283-71b4b8256552 None None] PATH_INFO: `/` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:58.711703 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 837/1643] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:30:58.743613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d544-7d7d-4189-9025-de0cc59f2a8c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:58.744211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d544-7d7d-4189-9025-de0cc59f2a8c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:58.744211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d544-7d7d-4189-9025-de0cc59f2a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:58.764982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0125d544-7d7d-4189-9025-de0cc59f2a8c None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:30:58.766358 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0125d544-7d7d-4189-9025-de0cc59f2a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:30:58.777635 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 807/1644] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:30:58.794145 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ec786-ac68-4d79-a283-71b4b8256552 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:58.808053 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ec786-ac68-4d79-a283-71b4b8256552 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:58.814052 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81ea0c-6c76-4020-a6a1-72e4f3d6e967 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05057b8842ea4cf88ba987b913308cd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:58.815174 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81ea0c-6c76-4020-a6a1-72e4f3d6e967 service placement] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:58.815442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81ea0c-6c76-4020-a6a1-72e4f3d6e967 service placement] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:58.815705 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81ea0c-6c76-4020-a6a1-72e4f3d6e967 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:58.824369 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81ea0c-6c76-4020-a6a1-72e4f3d6e967 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:58.825931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81ea0c-6c76-4020-a6a1-72e4f3d6e967 service placement] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:58.836627 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 838/1645] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:01.979794 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca438d-968a-4186-bf30-a2043b653654 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:01.980303 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca438d-968a-4186-bf30-a2043b653654 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:01.980580 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca438d-968a-4186-bf30-a2043b653654 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:01.982071 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 808/1646] 10.222.0.65 () {54 vars in 921 bytes} [Wed Sep 14 15:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:31:01.992613 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4fbad-1dcb-49e7-9d2c-2279773b1287 None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:01.993085 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4fbad-1dcb-49e7-9d2c-2279773b1287 None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:01.993161 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4fbad-1dcb-49e7-9d2c-2279773b1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:02.014743 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-fec4fbad-1dcb-49e7-9d2c-2279773b1287 None None] MFA Rules not processed for user `05057b8842ea4cf88ba987b913308cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:31:02.015984 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-fec4fbad-1dcb-49e7-9d2c-2279773b1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:02.026808 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 839/1647] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Sep 14 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:31:02.044861 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca438d-968a-4186-bf30-a2043b653654 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:02.070442 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4fbad-1dcb-49e7-9d2c-2279773b1287 None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:02.074618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca438d-968a-4186-bf30-a2043b653654 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:02.082884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05057b8842ea4cf88ba987b913308cd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:02.083503 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:02.083784 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:02.084140 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:02.085802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4fbad-1dcb-49e7-9d2c-2279773b1287 None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:02.092611 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:02.093187 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:02.093504 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:02.093958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] PATH_INFO: `/v3/users/cf20058e11614e68ac3b60d744b16843` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:02.094277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:02.095918 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf20058e11614e68ac3b60d744b16843)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:02.096633 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:02.097460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: WARNING py.warnings [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:31:02.097460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: warnings.warn(msg) Sep 14 15:31:02.097460 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: Sep 14 15:31:02.098982 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:02.109443 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 809/1648] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:02.172541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf20058e11614e68ac3b60d744b16843'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.173190 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf20058e11614e68ac3b60d744b16843'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.184421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf20058e11614e68ac3b60d744b16843'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.202571 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf20058e11614e68ac3b60d744b16843'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.203276 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf20058e11614e68ac3b60d744b16843'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.216662 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 840/1649] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Sep 14 15:31:02 2022] DELETE /identity/v3/users/cf20058e11614e68ac3b60d744b16843 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:31:02.391363 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:02.402823 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259c71-36db-499f-9b68-908f5cb79f7a service placement] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:02.471958 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:02.472524 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:02.472924 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:02.473060 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] PATH_INFO: `/v3/projects/7e95fc3475a94a3d9ab3f9452fc3b4aa` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:02.474277 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e95fc3475a94a3d9ab3f9452fc3b4aa)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:02.475328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: WARNING py.warnings [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:31:02.475328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: warnings.warn(msg) Sep 14 15:31:02.475328 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: Sep 14 15:31:02.476584 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:02.538536 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e95fc3475a94a3d9ab3f9452fc3b4aa', 'request_id': 'req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.552639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e95fc3475a94a3d9ab3f9452fc3b4aa', 'request_id': 'req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.555156 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:02.560216 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e95fc3475a94a3d9ab3f9452fc3b4aa', 'request_id': 'req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.576889 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] The token cache is being invalidate because project 7e95fc3475a94a3d9ab3f9452fc3b4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:31:02.577182 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.577897 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.579470 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 810/1650] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Sep 14 15:31:02 2022] DELETE /identity/v3/projects/7e95fc3475a94a3d9ab3f9452fc3b4aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:31:02.584211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:02.585712 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:02.598869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442b169-4c1d-4395-a32d-686855404e23 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:02.655491 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:02.656159 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:02.656436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:02.656707 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] PATH_INFO: `/v3/users/07bcbda6b9a54f9d9961c7d9d7dc34b1` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:02.657844 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bcbda6b9a54f9d9961c7d9d7dc34b1)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:02.660029 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:02.673003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:02.710089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bcbda6b9a54f9d9961c7d9d7dc34b1'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.710760 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bcbda6b9a54f9d9961c7d9d7dc34b1'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.717614 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bcbda6b9a54f9d9961c7d9d7dc34b1'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.729425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bcbda6b9a54f9d9961c7d9d7dc34b1'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.730023 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-907e9762-827e-4ebe-ae6c-01ddcd1122d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bcbda6b9a54f9d9961c7d9d7dc34b1'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:02.742952 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 841/1651] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Sep 14 15:31:02 2022] DELETE /identity/v3/users/07bcbda6b9a54f9d9961c7d9d7dc34b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:31:02.932762 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:02.934240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:02.950105 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738b7c-5fdc-479f-9910-c90d5c7ce2e4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:03.008681 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:03.009333 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:03.009637 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:03.009915 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] PATH_INFO: `/v3/projects/00b7fe4aa67040dd8267d750c94f459a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:03.011057 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b7fe4aa67040dd8267d750c94f459a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:03.013026 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:03.063007 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b7fe4aa67040dd8267d750c94f459a', 'request_id': 'req-05154665-10d1-45fe-9154-965d161ca309'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:03.070573 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b7fe4aa67040dd8267d750c94f459a', 'request_id': 'req-05154665-10d1-45fe-9154-965d161ca309'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:03.076546 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b7fe4aa67040dd8267d750c94f459a', 'request_id': 'req-05154665-10d1-45fe-9154-965d161ca309'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:03.090505 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] The token cache is being invalidate because project 00b7fe4aa67040dd8267d750c94f459a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:31:03.090798 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:03.091436 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:31:03.093464 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 811/1652] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Sep 14 15:31:02 2022] DELETE /identity/v3/projects/00b7fe4aa67040dd8267d750c94f459a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:31:12.739394 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:13.086910 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:31.617642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] REQUEST_METHOD: `POST` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:31.618123 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:31.618214 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:31.637671 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.auth.core [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] MFA Rules not processed for user `5223e9f5157743419bec0870f6917f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:31:31.638894 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:31.694500 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 842/1653] 10.222.0.65 () {58 vars in 958 bytes} [Wed Sep 14 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:31:32.017756 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:32.019259 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:32.076907 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05154665-10d1-45fe-9154-965d161ca309 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:32.080526 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:32.081158 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:32.081438 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:32.081718 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:32.083466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:32.092857 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:32.094273 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:32.102098 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 812/1654] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:32.545039 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:32.546501 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:32.621599 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c617c-31b1-4393-8af8-16558dc78bcc None None] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:32.626515 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05057b8842ea4cf88ba987b913308cd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:32.627117 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:32.627416 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:32.627679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:32.629548 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:32.641379 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:32.642943 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:32.653641 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 843/1655] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:42.098650 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=26 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:42.649255 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=57 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:44.911848 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:44.914030 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:44.989530 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b7b5f-0436-4638-8521-c4acf8f5d67e service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:44.994870 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b507a36c834754bd4ac76935e64b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:44.995474 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:44.995752 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:44.996048 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:44.997749 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:45.009639 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:45.011222 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:45.022339 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 813/1656] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:31:55.017842 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=34 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:30.012938 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:30.014373 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:30.076400 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e4e7-e3f2-485b-9ad2-9a4d1532334d service placement] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:30.080075 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '317574f1c46a45d9b600329f73a993f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:30.080679 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] REQUEST_METHOD: `GET` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:30.080953 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:30.081221 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:30.082946 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:30.186425 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:30.187884 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:30.206642 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 844/1657] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:33:36.550931 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:36.553021 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:36.604387 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16faa-8f72-4a7c-9942-3cf98f9d5eeb service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:36.609129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:36.609761 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:36.610043 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:36.610318 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] PATH_INFO: `/v3/users/5223e9f5157743419bec0870f6917f89` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:36.611449 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5223e9f5157743419bec0870f6917f89)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:36.613450 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:36.660516 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5223e9f5157743419bec0870f6917f89'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:36.668167 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5223e9f5157743419bec0870f6917f89'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:36.676338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5223e9f5157743419bec0870f6917f89'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:36.690643 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5223e9f5157743419bec0870f6917f89'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:36.691490 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5223e9f5157743419bec0870f6917f89'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:36.698717 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 814/1658] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Sep 14 15:33:36 2022] DELETE /identity/v3/users/5223e9f5157743419bec0870f6917f89 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:33:36.883211 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:36.895022 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105761-2139-4a35-9b51-b1e462e5781f service neutron] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:36.952618 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=100 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:36.960160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:36.960969 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:36.961338 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:36.961713 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] PATH_INFO: `/v3/projects/bef2ca5966c945d7b47b1cccba7399b2` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:36.963002 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef2ca5966c945d7b47b1cccba7399b2)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:36.965072 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:37.011266 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef2ca5966c945d7b47b1cccba7399b2', 'request_id': 'req-343a1975-9743-4cf8-ba19-49c15fefbd10'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.017311 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef2ca5966c945d7b47b1cccba7399b2', 'request_id': 'req-343a1975-9743-4cf8-ba19-49c15fefbd10'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.023467 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef2ca5966c945d7b47b1cccba7399b2', 'request_id': 'req-343a1975-9743-4cf8-ba19-49c15fefbd10'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.036466 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] The token cache is being invalidate because project bef2ca5966c945d7b47b1cccba7399b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:33:37.036754 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.037408 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.038920 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 845/1659] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Sep 14 15:33:36 2022] DELETE /identity/v3/projects/bef2ca5966c945d7b47b1cccba7399b2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:33:37.042955 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:37.044368 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:37.057419 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f4e42-85da-45cd-93f6-29cc71d09dfe admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:37.119541 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:37.120736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:37.120736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:37.120736 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] PATH_INFO: `/v3/users/4d6477cf16114cfba2eab4b13b67deda` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:37.121885 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6477cf16114cfba2eab4b13b67deda)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:37.123802 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:37.171785 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:37.177659 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6477cf16114cfba2eab4b13b67deda'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.187183 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6477cf16114cfba2eab4b13b67deda'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.195247 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6477cf16114cfba2eab4b13b67deda'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.208746 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6477cf16114cfba2eab4b13b67deda'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.209468 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6477cf16114cfba2eab4b13b67deda'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.215453 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 815/1660] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Sep 14 15:33:37 2022] DELETE /identity/v3/users/4d6477cf16114cfba2eab4b13b67deda => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:33:37.392502 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Authenticating user token {{(pid=81428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:37.394258 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.fernet_utils [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:37.410692 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a1975-9743-4cf8-ba19-49c15fefbd10 admin admin] Validating token access rules against request {{(pid=81428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:37.479118 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea41adfa24e148959dc896e18ec4fb9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52aec70ff9234a3bb3cc3d70110b0f57', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:37.479745 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:37.480160 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:37.481417 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] PATH_INFO: `/v3/projects/b6caf3ac0e254753994043e7e3a8227d` {{(pid=81428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:37.482550 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6caf3ac0e254753994043e7e3a8227d)` {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:37.485252 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] RBAC: Authorization granted {{(pid=81428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:37.535543 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6caf3ac0e254753994043e7e3a8227d', 'request_id': 'req-6f2e95f6-9ef1-4045-bd55-68a50524517a'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.542317 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6caf3ac0e254753994043e7e3a8227d', 'request_id': 'req-6f2e95f6-9ef1-4045-bd55-68a50524517a'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.547868 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6caf3ac0e254753994043e7e3a8227d', 'request_id': 'req-6f2e95f6-9ef1-4045-bd55-68a50524517a'} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.561227 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] The token cache is being invalidate because project b6caf3ac0e254753994043e7e3a8227d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:33:37.561509 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.562129 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG keystone.notifications [None req-6f2e95f6-9ef1-4045-bd55-68a50524517a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:33:37.563604 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: [pid: 81428|app: 0|req: 846/1661] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Sep 14 15:33:37 2022] DELETE /identity/v3/projects/b6caf3ac0e254753994043e7e3a8227d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:33:47.212003 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:47.557933 dv-osbrick-853789-4-iscsi devstack@keystone.service[81428]: DEBUG dbcounter [-] [81428] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:59.633819 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:59.635240 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:59.725542 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1efb3-b071-467c-98d8-a36b42a15086 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:59.783242 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1364609-0d99-4feb-9ca1-fce413ccb96d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05057b8842ea4cf88ba987b913308cd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7029d85fe9f4a3194e1873062103d37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:59.783869 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364609-0d99-4feb-9ca1-fce413ccb96d service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:59.784151 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364609-0d99-4feb-9ca1-fce413ccb96d service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:59.784421 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364609-0d99-4feb-9ca1-fce413ccb96d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:59.786404 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b1364609-0d99-4feb-9ca1-fce413ccb96d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:59.797675 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1364609-0d99-4feb-9ca1-fce413ccb96d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:59.799237 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1364609-0d99-4feb-9ca1-fce413ccb96d service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:59.809089 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 816/1662] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Sep 14 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:34:09.804851 dv-osbrick-853789-4-iscsi devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=67 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}